2024-09-16T16:32:42.413 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T16:32:42.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T16:32:42.514 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} email: null first_in_suite: false job_id: '7907394' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6678 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO2fj11SKcdf6MBfev2iOTi3n348lroWshIePSP9iplYCZ8M36a3Z+E0Kdrm2tgcLkvripK6Z1Wgcs/3K2vmYx8= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECqSDjKTRhi4j0Cg88trN0g6oVs/boTwKvIS4E9bmirDlDwJkNExS9INzaYvPsSCHhrgljpuemOjk2d+755GCs= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_16:23:48 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T16:32:42.515 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T16:32:42.515 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T16:32:42.515 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T16:32:42.517 INFO:teuthology.task.internal:Checking packages... 2024-09-16T16:32:42.540 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T16:32:42.540 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T16:32:42.540 INFO:teuthology.packaging:ref: None 2024-09-16T16:32:42.540 INFO:teuthology.packaging:tag: None 2024-09-16T16:32:42.540 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T16:32:42.540 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:32:42.541 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T16:32:42.678 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T16:32:42.680 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T16:32:42.686 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T16:32:42.686 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T16:32:42.724 INFO:teuthology.task.internal:Saving configuration 2024-09-16T16:32:42.741 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T16:32:42.749 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T16:32:42.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:59.850383', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO2fj11SKcdf6MBfev2iOTi3n348lroWshIePSP9iplYCZ8M36a3Z+E0Kdrm2tgcLkvripK6Z1Wgcs/3K2vmYx8='} 2024-09-16T16:32:42.791 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 16:24:59.851894', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECqSDjKTRhi4j0Cg88trN0g6oVs/boTwKvIS4E9bmirDlDwJkNExS9INzaYvPsSCHhrgljpuemOjk2d+755GCs='} 2024-09-16T16:32:42.792 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T16:32:42.798 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-16T16:32:42.798 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T16:32:42.798 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T16:32:42.874 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc2bb3fbe0>, signals=[15]) 2024-09-16T16:32:42.874 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T16:32:42.880 INFO:teuthology.task.internal:Opening connections... 2024-09-16T16:32:42.880 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-16T16:32:42.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:42.960 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T16:32:42.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:32:43.036 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T16:32:43.043 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-16T16:32:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-16T16:32:43.061 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-16T16:32:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-16T16:32:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-16T16:32:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-16T16:32:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-16T16:32:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:43.121 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-16T16:32:43.147 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-16T16:32:43.165 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-16T16:32:43.165 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T16:32:43.222 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-09-16T16:32:43.223 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T16:32:43.223 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T16:32:43.223 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T16:32:43.223 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-16T16:32:43.246 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T16:32:43.255 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T16:32:43.275 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T16:32:43.275 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:43.277 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-16T16:32:43.293 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T16:32:43.299 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T16:32:43.299 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:43.335 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-16T16:32:43.562 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T16:32:43.617 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T16:32:43.631 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T16:32:43.631 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T16:32:43.631 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:43.632 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T16:32:43.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:43.649 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-16T16:32:43.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:32:43.650 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-16T16:32:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:43.707 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-16T16:32:43.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-16T16:32:43.708 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-503.el9.x86_64 2024-09-16T16:32:43.708 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.14.0-503.el9.x86_64 2024-09-16T16:32:43.709 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum install -y kernel 2024-09-16T16:32:46.309 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-16T16:32:46.315 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.2 MB 00:00 2024-09-16T16:32:49.785 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 20 MB 00:02 2024-09-16T16:32:52.458 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-09-16T16:32:55.328 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-16T16:32:56.836 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-16T16:32:58.233 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-16T16:32:58.607 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-16T16:33:00.534 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-16T16:33:02.038 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-16T16:33:04.021 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T16:33:06.036 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:33:06.036 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:33:06.122 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:33:06.124 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:33:06.125 INFO:teuthology.orchestra.run.smithi110.stdout:Install 4 Packages 2024-09-16T16:33:06.126 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:33:06.126 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 79 M 2024-09-16T16:33:06.126 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 126 M 2024-09-16T16:33:06.126 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:33:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 181 kB/s | 23 kB 00:00 2024-09-16T16:33:07.802 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T16:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-16T16:33:09.942 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T16:33:09.942 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T16:33:10.031 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:33:10.046 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-16T16:33:10.047 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:33:10.048 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-16T16:33:10.048 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-16T16:33:10.048 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:33:10.553 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 64 kB/s | 23 kB 00:00 2024-09-16T16:33:11.814 INFO:teuthology.orchestra.run.smithi110.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.2 MB/s | 35 MB 00:05 2024-09-16T16:33:13.348 INFO:teuthology.orchestra.run.smithi110.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.1 MB/s | 29 MB 00:06 2024-09-16T16:33:13.348 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:33:13.348 INFO:teuthology.orchestra.run.smithi110.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-16T16:33:14.026 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:33:14.395 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:33:14.396 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:33:15.342 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:33:15.343 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:33:17.788 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:33:18.554 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:18.633 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:21.421 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:33:21.560 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-16T16:33:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:33:26.460 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:26.960 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 956 kB/s | 16 MB 00:16 2024-09-16T16:33:31.305 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:33:52.216 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 842 kB/s | 35 MB 00:42 2024-09-16T16:33:52.216 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:33:52.216 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.9 MB/s | 79 MB 00:42 2024-09-16T16:33:52.917 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:33:53.296 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:33:53.296 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:33:54.265 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:33:54.265 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:33:56.852 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:33:57.550 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:33:57.749 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:34:00.529 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:34:00.660 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:34:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:34:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:09.718 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:10.112 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:10.112 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:34:10.112 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:34:10.112 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:34:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:34:10.969 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:34:11.331 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:11.424 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:11.425 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:11.425 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:34:11.425 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:34:11.425 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:34:11.425 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T16:34:11.425 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:34:11.425 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:11.484 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:11.485 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:11.485 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-09-16T16:34:11.523 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-09-16T16:34:11.523 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-09-16T16:34:11.523 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-09-16T16:34:11.523 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 82.el9 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8274670 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-09-16T16:34:11.524 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:34:11.525 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:34:11.526 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:34:11.526 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:34:11.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:34:12.154 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-09-16T16:34:13.547 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:34:13.577 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-09-16T16:34:13.587 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-16T16:34:13.603 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.uD7BdEkrZ5 2024-09-16T16:34:13.603 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uD7BdEkrZ5 2024-09-16T16:34:13.676 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.uD7BdEkrZ5 2024-09-16T16:34:13.813 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.uD7BdEkrZ5 is 6KB 2024-09-16T16:34:13.833 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.uD7BdEkrZ5 2024-09-16T16:34:13.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:34:13.919 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:34:13.919 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:34:13.919 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:34:13.919 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:34:13.921 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:34:14.077 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-09-16T16:34:44.080 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T16:34:44.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T16:34:44.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:34:49.727 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:49.767 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:50.117 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:50.118 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T16:34:50.118 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T16:34:50.118 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T16:34:50.989 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:34:50.990 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:34:51.323 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:51.403 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:51.403 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:51.403 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T16:34:51.403 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T16:34:51.403 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T16:34:51.403 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T16:34:51.404 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T16:34:51.404 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T16:34:51.462 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T16:34:51.463 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T16:34:51.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-16T16:34:51.505 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-16T16:34:51.506 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:34:51.507 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T16:34:51.507 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T16:34:51.507 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T16:34:51.507 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-16T16:34:51.507 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:34:51.507 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T16:34:51.508 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T16:34:51.508 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-505.el9.x86_64 2024-09-16T16:34:51.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T16:34:52.131 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-16T16:34:53.349 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T16:34:53.373 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-16T16:34:53.380 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-16T16:34:53.395 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.XBTvmwmpRH 2024-09-16T16:34:53.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XBTvmwmpRH 2024-09-16T16:34:53.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.XBTvmwmpRH 2024-09-16T16:34:53.602 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.XBTvmwmpRH is 6KB 2024-09-16T16:34:53.651 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.XBTvmwmpRH 2024-09-16T16:34:53.667 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T16:34:53.728 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T16:34:53.729 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T16:34:53.729 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T16:34:53.729 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T16:34:53.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T16:34:53.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-16T16:35:23.909 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T16:35:23.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-16T16:35:23.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:44.103 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T16:35:53.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T16:35:53.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:35:53.544 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-16T16:35:53.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T16:35:53.951 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:35:53.951 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-16T16:35:53.966 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:35:53.966 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:35:53.966 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:35:53.967 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:35:54.967 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T16:35:54.968 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:35:55.059 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-09-16T16:35:55.080 DEBUG:teuthology.parallel:result is None 2024-09-16T16:36:23.913 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T16:36:32.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-16T16:36:32.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:36:33.342 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-16T16:36:33.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-16T16:36:33.742 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T16:36:33.743 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-16T16:36:33.758 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-505.el9.x86_64 2024-09-16T16:36:33.759 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T16:36:33.759 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T16:36:33.759 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T16:36:34.760 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T16:36:34.760 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T16:36:34.856 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-16T16:36:34.876 DEBUG:teuthology.parallel:result is None 2024-09-16T16:36:34.876 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T16:36:34.885 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T16:36:34.885 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:36:34.888 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T16:36:34.907 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T16:36:34.937 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T16:36:34.970 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T16:36:34.970 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:36:34.972 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T16:36:35.011 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T16:36:35.034 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T16:36:35.034 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:36:35.043 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T16:36:35.080 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:35.080 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:35.108 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:35.119 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T16:36:35.121 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T16:36:35.129 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T16:36:35.129 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:36:35.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T16:36:35.190 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T16:36:35.201 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T16:36:35.202 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:36:35.205 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T16:36:35.249 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:35.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:35.358 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:35.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:35.483 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:36:35.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:36:35.560 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:35.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T16:36:35.662 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:35.754 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T16:36:35.798 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:36:35.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T16:36:35.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-16T16:36:35.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-16T16:36:35.917 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:36:35.954 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T16:36:36.384 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T16:36:36.392 INFO:teuthology.task.internal:Starting timer... 2024-09-16T16:36:36.392 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T16:36:36.437 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T16:36:36.471 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T16:36:36.471 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-16T16:36:36.535 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-16T16:36:36.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-09-16T16:36:36.604 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-09-16T16:36:36.606 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T16:36:36.606 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-16T16:36:36.634 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-16T16:36:36.634 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-09-16T16:36:36.671 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-09-16T16:36:36.672 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive'} 2024-09-16T16:36:36.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:36:36.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:36:36.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T16:36:36.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T16:36:36.741 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T16:36:36.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:36:36.772 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-09-16T16:36:36.817 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T16:36:36.850 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T16:36:36.879 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T16:36:36.880 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T16:40:57.761 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-09-16T16:40:57.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-16T16:40:57.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:40:57.847 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-16T16:40:57.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-16T16:40:57.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T16:40:57.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T16:40:58.002 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-16T16:40:58.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-16T16:40:58.089 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T16:40:58.103 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T16:40:58.103 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:40:58.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:40:58.106 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T16:40:58.106 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T16:40:58.135 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:40:58.150 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:40:58.159 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T16:40:58.173 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T16:40:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-16T16:40:58.188 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-16T16:40:58.197 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-09-16T16:40:58.203 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:40:58.208 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-09-16T16:40:58.218 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:40:58.222 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T16:40:58.236 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T16:40:58.274 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:40:58.278 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:40:58.278 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-16T16:40:58.278 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.278 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.278 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.278 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.297 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-16T16:40:58.300 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T16:40:58.301 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-16T16:40:58.301 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.301 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.301 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.301 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T16:40:58.301 INFO:teuthology.run_tasks:Running task install... 2024-09-16T16:40:58.310 DEBUG:teuthology.task.install:project ceph 2024-09-16T16:40:58.310 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T16:40:58.310 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T16:40:58.310 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T16:40:58.317 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T16:40:58.317 INFO:teuthology.task.install:extra packages: [] 2024-09-16T16:40:58.317 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:40:58.319 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:40:58.321 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T16:40:58.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:40:58.469 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:40:58.469 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:40:58.475 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T16:40:58.475 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T16:40:58.782 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:40:58.782 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:40:58.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:40:58.793 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T16:40:58.793 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:40:58.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T16:40:58.811 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:40:58.811 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:40:58.818 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T16:40:58.818 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T16:40:58.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:40:58.884 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T16:40:58.957 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:40:58.959 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T16:40:59.023 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-16T16:40:59.023 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-09-16T16:40:59.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-16T16:40:59.025 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-09-16T16:40:59.252 INFO:teuthology.orchestra.run.smithi110.stdout:45 files removed 2024-09-16T16:40:59.259 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-16T16:40:59.280 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw 2024-09-16T16:40:59.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw 2024-09-16T16:41:00.369 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 110 kB/s | 88 kB 00:00 2024-09-16T16:41:00.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 108 kB/s | 88 kB 00:00 2024-09-16T16:41:01.128 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 33 kB/s | 24 kB 00:00 2024-09-16T16:41:01.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 33 kB/s | 24 kB 00:00 2024-09-16T16:41:01.829 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 3.1 kB/s | 2.1 kB 00:00 2024-09-16T16:41:01.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 3.1 kB/s | 2.1 kB 00:00 2024-09-16T16:41:02.481 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-16T16:41:02.637 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-16T16:41:04.590 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-16T16:41:04.646 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-16T16:41:08.989 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T16:41:10.374 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-16T16:41:10.498 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-16T16:41:11.867 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-16T16:41:11.869 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-16T16:41:13.471 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-16T16:41:17.350 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-16T16:41:19.126 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T16:41:19.711 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:41:19.724 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:41:19.724 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:41:19.725 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:41:19.726 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-09-16T16:41:19.727 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:41:19.728 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:41:19.728 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:41:19.728 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:41:19.728 INFO:teuthology.orchestra.run.smithi110.stdout:Install 31 Packages 2024-09-16T16:41:19.728 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 2 Packages 2024-09-16T16:41:19.728 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:41:19.728 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 60 M 2024-09-16T16:41:19.729 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:41:21.580 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T16:41:21.596 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T16:41:21.597 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T16:41:21.598 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout:Install 31 Packages 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2024-09-16T16:41:21.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:41:21.600 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 60 M 2024-09-16T16:41:21.600 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:41:27.802 INFO:teuthology.orchestra.run.smithi002.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 1.0 MB/s | 6.1 MB 00:05 2024-09-16T16:41:27.894 INFO:teuthology.orchestra.run.smithi002.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 275 kB/s | 25 kB 00:00 2024-09-16T16:41:28.552 INFO:teuthology.orchestra.run.smithi002.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 1.2 MB/s | 809 kB 00:00 2024-09-16T16:41:28.986 INFO:teuthology.orchestra.run.smithi002.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 1.3 MB/s | 558 kB 00:00 2024-09-16T16:41:29.367 INFO:teuthology.orchestra.run.smithi110.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 658 kB/s | 6.1 MB 00:09 2024-09-16T16:41:29.476 INFO:teuthology.orchestra.run.smithi110.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 232 kB/s | 25 kB 00:00 2024-09-16T16:41:30.843 INFO:teuthology.orchestra.run.smithi110.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 592 kB/s | 809 kB 00:01 2024-09-16T16:41:32.234 INFO:teuthology.orchestra.run.smithi110.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 401 kB/s | 558 kB 00:01 2024-09-16T16:41:32.977 INFO:teuthology.orchestra.run.smithi002.stdout:(5/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 1.3 MB/s | 5.4 MB 00:03 2024-09-16T16:41:33.652 INFO:teuthology.orchestra.run.smithi002.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 67 kB/s | 45 kB 00:00 2024-09-16T16:41:33.919 INFO:teuthology.orchestra.run.smithi002.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 537 kB/s | 143 kB 00:00 2024-09-16T16:41:34.345 INFO:teuthology.orchestra.run.smithi002.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 376 kB/s | 160 kB 00:00 2024-09-16T16:41:35.086 INFO:teuthology.orchestra.run.smithi002.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 425 kB/s | 315 kB 00:00 2024-09-16T16:41:35.745 INFO:teuthology.orchestra.run.smithi002.stdout:(10/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 458 kB/s | 302 kB 00:00 2024-09-16T16:41:36.012 INFO:teuthology.orchestra.run.smithi002.stdout:(11/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 373 kB/s | 99 kB 00:00 2024-09-16T16:41:36.120 INFO:teuthology.orchestra.run.smithi002.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 989 kB/s | 107 kB 00:00 2024-09-16T16:41:36.179 INFO:teuthology.orchestra.run.smithi002.stdout:(13/33): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-16T16:41:36.221 INFO:teuthology.orchestra.run.smithi002.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-16T16:41:36.263 INFO:teuthology.orchestra.run.smithi002.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T16:41:36.330 INFO:teuthology.orchestra.run.smithi002.stdout:(16/33): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-16T16:41:36.447 INFO:teuthology.orchestra.run.smithi002.stdout:(17/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9 727 kB/s | 10 MB 00:14 2024-09-16T16:41:36.472 INFO:teuthology.orchestra.run.smithi002.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-16T16:41:36.514 INFO:teuthology.orchestra.run.smithi002.stdout:(19/33): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-16T16:41:36.539 INFO:teuthology.orchestra.run.smithi002.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 459 kB/s | 42 kB 00:00 2024-09-16T16:41:36.564 INFO:teuthology.orchestra.run.smithi002.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 716 kB/s | 36 kB 00:00 2024-09-16T16:41:36.598 INFO:teuthology.orchestra.run.smithi002.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-16T16:41:36.642 INFO:teuthology.orchestra.run.smithi002.stdout:(23/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.9 MB/s | 308 kB 00:00 2024-09-16T16:41:36.667 INFO:teuthology.orchestra.run.smithi002.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-16T16:41:36.701 INFO:teuthology.orchestra.run.smithi002.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-16T16:41:36.743 INFO:teuthology.orchestra.run.smithi002.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-16T16:41:36.818 INFO:teuthology.orchestra.run.smithi002.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-16T16:41:36.852 INFO:teuthology.orchestra.run.smithi002.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T16:41:36.986 INFO:teuthology.orchestra.run.smithi002.stdout:(29/33): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-16T16:41:37.061 INFO:teuthology.orchestra.run.smithi002.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-09-16T16:41:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:(31/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 601 kB/s | 3.5 MB 00:05 2024-09-16T16:41:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 651 kB/s | 3.8 MB 00:05 2024-09-16T16:41:45.617 INFO:teuthology.orchestra.run.smithi110.stdout:(5/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 412 kB/s | 5.4 MB 00:13 2024-09-16T16:41:45.800 INFO:teuthology.orchestra.run.smithi110.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 246 kB/s | 45 kB 00:00 2024-09-16T16:41:46.226 INFO:teuthology.orchestra.run.smithi110.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 337 kB/s | 143 kB 00:00 2024-09-16T16:41:46.651 INFO:teuthology.orchestra.run.smithi110.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 376 kB/s | 160 kB 00:00 2024-09-16T16:41:47.043 INFO:teuthology.orchestra.run.smithi110.stdout:(9/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 747 kB/s | 20 MB 00:27 2024-09-16T16:41:47.427 INFO:teuthology.orchestra.run.smithi110.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 406 kB/s | 315 kB 00:00 2024-09-16T16:41:47.535 INFO:teuthology.orchestra.run.smithi110.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 614 kB/s | 302 kB 00:00 2024-09-16T16:41:47.669 INFO:teuthology.orchestra.run.smithi110.stdout:(12/33): boost-program-options-1.75.0-8.el9.x86 803 kB/s | 107 kB 00:00 2024-09-16T16:41:47.694 INFO:teuthology.orchestra.run.smithi110.stdout:(13/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 372 kB/s | 99 kB 00:00 2024-09-16T16:41:47.744 INFO:teuthology.orchestra.run.smithi110.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-16T16:41:47.819 INFO:teuthology.orchestra.run.smithi110.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-16T16:41:47.836 INFO:teuthology.orchestra.run.smithi110.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-16T16:41:47.912 INFO:teuthology.orchestra.run.smithi110.stdout:(17/33): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-16T16:41:47.937 INFO:teuthology.orchestra.run.smithi110.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-16T16:41:47.971 INFO:teuthology.orchestra.run.smithi110.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 718 kB/s | 42 kB 00:00 2024-09-16T16:41:48.013 INFO:teuthology.orchestra.run.smithi110.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-16T16:41:48.038 INFO:teuthology.orchestra.run.smithi110.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 536 kB/s | 36 kB 00:00 2024-09-16T16:41:48.072 INFO:teuthology.orchestra.run.smithi110.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-16T16:41:48.114 INFO:teuthology.orchestra.run.smithi110.stdout:(23/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-16T16:41:48.131 INFO:teuthology.orchestra.run.smithi110.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.7 MB/s | 26 kB 00:00 2024-09-16T16:41:48.156 INFO:teuthology.orchestra.run.smithi110.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T16:41:48.181 INFO:teuthology.orchestra.run.smithi110.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T16:41:48.282 INFO:teuthology.orchestra.run.smithi110.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-16T16:41:48.315 INFO:teuthology.orchestra.run.smithi110.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T16:41:48.449 INFO:teuthology.orchestra.run.smithi110.stdout:(29/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-16T16:41:48.491 INFO:teuthology.orchestra.run.smithi110.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-16T16:41:50.133 INFO:teuthology.orchestra.run.smithi110.stdout:(31/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9 352 kB/s | 10 MB 00:30 2024-09-16T16:41:56.141 INFO:teuthology.orchestra.run.smithi110.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 508 kB/s | 3.8 MB 00:07 2024-09-16T16:41:57.082 INFO:teuthology.orchestra.run.smithi110.stdout:(33/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 411 kB/s | 3.5 MB 00:08 2024-09-16T16:41:57.088 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:41:57.088 INFO:teuthology.orchestra.run.smithi110.stdout:Total 1.6 MB/s | 60 MB 00:37 2024-09-16T16:41:57.199 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:41:57.236 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:41:57.236 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:41:57.940 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:41:57.940 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:41:59.466 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:41:59.954 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:42:00.026 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:42:00.102 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:42:00.202 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:42:00.237 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:42:00.299 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:42:00.341 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:42:00.375 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:42:00.400 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:42:00.422 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:42:00.449 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:42:00.641 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:42:00.675 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:42:00.724 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:42:00.768 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:42:00.797 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:42:00.875 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:42:00.902 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:42:00.973 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:42:01.010 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:42:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:42:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:42:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:42:01.234 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:42:01.263 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:42:01.300 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:42:01.654 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:42:01.701 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:42:01.791 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:42:01.823 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:42:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:42:02.437 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:42:02.462 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:42:02.525 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:42:02.594 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:42:02.623 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:42:05.108 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:05.153 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:05.870 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:05.915 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:42:06.002 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:42:06.002 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:42:06.002 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:42:06.002 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:42:06.033 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:15.183 INFO:teuthology.orchestra.run.smithi002.stdout:(33/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 379 kB/s | 20 MB 00:53 2024-09-16T16:42:15.189 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:42:15.189 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.1 MB/s | 60 MB 00:53 2024-09-16T16:42:15.306 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:42:15.347 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:42:15.348 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:42:16.018 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:16.018 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-09-16T16:42:16.019 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-09-16T16:42:16.019 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-09-16T16:42:16.019 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-09-16T16:42:16.019 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-09-16T16:42:16.019 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-09-16T16:42:16.019 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-09-16T16:42:16.019 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:42:16.043 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:42:16.044 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:42:17.113 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:42:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:42:17.138 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:42:17.138 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:42:17.138 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:42:17.138 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:42:17.138 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:42:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:42:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:42:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:17.589 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:42:18.106 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T16:42:18.193 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:42:18.286 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:42:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:42:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:42:18.472 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:42:18.472 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:42:18.472 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:42:18.472 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:42:18.472 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:42:18.472 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:42:18.472 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:42:18.473 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:42:18.473 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:42:18.473 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:42:18.473 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:42:18.474 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:18.474 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:42:18.474 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:42:18.495 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:42:18.558 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:42:18.607 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T16:42:18.649 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T16:42:18.675 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T16:42:18.697 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:42:18.734 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T16:42:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:42:18.964 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T16:42:18.999 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T16:42:19.043 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T16:42:19.080 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:42:19.179 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T16:42:19.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:42:19.306 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T16:42:19.351 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T16:42:19.449 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:19.449 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:42:19.449 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-09-16T16:42:19.449 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.449 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.449 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:42:19.450 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.451 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:19.452 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:42:19.452 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:42:19.452 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:42:19.452 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:42:19.452 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:42:19.452 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:42:19.452 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:42:19.461 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T16:42:19.501 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T16:42:19.542 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T16:42:19.575 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T16:42:19.604 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T16:42:19.651 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T16:42:19.822 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-test 2024-09-16T16:42:20.031 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T16:42:20.083 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:42:20.168 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T16:42:20.206 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T16:42:20.258 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T16:42:20.382 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:03 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:42:20.523 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:42:20.523 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:42:20.524 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:42:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:42:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:42:20.525 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:42:20.525 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:42:20.525 INFO:teuthology.orchestra.run.smithi110.stdout:Install 9 Packages 2024-09-16T16:42:20.525 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:42:20.525 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 87 M 2024-09-16T16:42:20.526 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 797 M 2024-09-16T16:42:20.526 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:42:20.878 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T16:42:20.910 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:42:20.991 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T16:42:21.072 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T16:42:21.104 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T16:42:21.114 INFO:teuthology.orchestra.run.smithi110.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 548 kB/s | 94 kB 00:00 2024-09-16T16:42:21.264 INFO:teuthology.orchestra.run.smithi110.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.4 MB/s | 513 kB 00:00 2024-09-16T16:42:21.323 INFO:teuthology.orchestra.run.smithi110.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-16T16:42:21.415 INFO:teuthology.orchestra.run.smithi110.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-16T16:42:21.474 INFO:teuthology.orchestra.run.smithi110.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-16T16:42:21.524 INFO:teuthology.orchestra.run.smithi110.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T16:42:21.549 INFO:teuthology.orchestra.run.smithi110.stdout:(7/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 288 kB/s | 175 kB 00:00 2024-09-16T16:42:21.591 INFO:teuthology.orchestra.run.smithi110.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-16T16:42:23.721 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:23.759 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:24.517 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T16:42:24.670 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:42:24.764 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T16:42:24.764 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T16:42:24.764 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T16:42:24.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:42:24.813 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:35.390 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-16T16:42:35.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:42:36.512 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:42:36.538 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T16:42:36.538 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:42:36.539 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T16:42:36.539 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:42:36.539 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T16:42:36.539 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:42:36.540 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:42:36.630 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T16:42:36.631 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T16:42:38.055 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T16:42:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T16:42:38.057 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T16:42:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T16:42:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T16:42:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T16:42:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T16:42:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T16:42:38.058 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T16:42:38.059 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T16:42:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T16:42:39.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.054 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:42:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:42:39.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-test 2024-09-16T16:42:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:21 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:42:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:42:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:42:40.149 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:42:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T16:42:40.150 INFO:teuthology.orchestra.run.smithi002.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T16:42:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:42:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:42:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:42:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:Install 9 Packages 2024-09-16T16:42:40.151 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:42:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 87 M 2024-09-16T16:42:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 797 M 2024-09-16T16:42:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:42:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 598 kB/s | 94 kB 00:00 2024-09-16T16:42:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.3 MB/s | 513 kB 00:00 2024-09-16T16:42:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 183 kB 00:00 2024-09-16T16:42:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-16T16:42:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-16T16:42:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 64 kB 00:00 2024-09-16T16:42:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:(7/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 262 kB/s | 175 kB 00:00 2024-09-16T16:42:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.4 MB/s | 122 kB 00:00 2024-09-16T16:43:15.762 INFO:teuthology.orchestra.run.smithi110.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 1.5 MB/s | 85 MB 00:54 2024-09-16T16:43:15.764 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:43:15.764 INFO:teuthology.orchestra.run.smithi110.stdout:Total 1.6 MB/s | 87 MB 00:55 2024-09-16T16:43:15.843 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:43:15.866 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:43:15.867 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:43:16.505 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:43:16.505 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:43:17.378 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:43:17.452 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:43:17.497 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:43:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:43:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:43:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:17.708 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:43:17.749 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:43:17.783 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:43:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:43:35.103 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:43:35.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:43:35.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:43:35.103 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:43:35.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:43:35.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:43:35.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:43:35.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:43:35.104 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:43:35.499 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:43:35.499 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:43:35.499 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:43:35.500 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:43:35.851 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph 2024-09-16T16:43:36.412 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:02:19 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:43:36.548 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:43:36.550 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:43:36.550 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:43:36.550 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:43:36.550 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:43:36.551 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:43:36.552 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:43:36.553 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:43:36.554 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:43:36.554 INFO:teuthology.orchestra.run.smithi110.stdout:Install 37 Packages 2024-09-16T16:43:36.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:43:36.554 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 84 M 2024-09-16T16:43:36.554 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 897 M 2024-09-16T16:43:36.554 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:43:37.554 INFO:teuthology.orchestra.run.smithi110.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 18 kB/s | 6.5 kB 00:00 2024-09-16T16:43:41.162 INFO:teuthology.orchestra.run.smithi110.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 566 kB/s | 2.2 MB 00:03 2024-09-16T16:43:41.204 INFO:teuthology.orchestra.run.smithi110.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 406 kB/s | 1.6 MB 00:04 2024-09-16T16:43:41.705 INFO:teuthology.orchestra.run.smithi110.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 582 kB/s | 291 kB 00:00 2024-09-16T16:43:41.830 INFO:teuthology.orchestra.run.smithi110.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-16T16:43:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-09-16T16:43:42.047 INFO:teuthology.orchestra.run.smithi110.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-16T16:43:42.114 INFO:teuthology.orchestra.run.smithi110.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-16T16:43:42.206 INFO:teuthology.orchestra.run.smithi110.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.3 MB/s | 125 kB 00:00 2024-09-16T16:43:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.2 MB/s | 215 kB 00:00 2024-09-16T16:43:42.998 INFO:teuthology.orchestra.run.smithi110.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 260 kB/s | 188 kB 00:00 2024-09-16T16:43:43.724 INFO:teuthology.orchestra.run.smithi110.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 238 kB/s | 172 kB 00:00 2024-09-16T16:43:44.107 INFO:teuthology.orchestra.run.smithi110.stdout:(13/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 798 kB/s | 5.1 MB 00:06 2024-09-16T16:43:44.291 INFO:teuthology.orchestra.run.smithi110.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2024-09-16T16:43:44.741 INFO:teuthology.orchestra.run.smithi110.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 122 kB/s | 77 kB 00:00 2024-09-16T16:43:44.933 INFO:teuthology.orchestra.run.smithi110.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-09-16T16:43:45.041 INFO:teuthology.orchestra.run.smithi110.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-09-16T16:43:45.092 INFO:teuthology.orchestra.run.smithi110.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-16T16:43:45.117 INFO:teuthology.orchestra.run.smithi110.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-16T16:43:45.151 INFO:teuthology.orchestra.run.smithi110.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.0 MB/s | 172 kB 00:00 2024-09-16T16:43:45.193 INFO:teuthology.orchestra.run.smithi110.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 8.4 MB/s | 358 kB 00:00 2024-09-16T16:43:45.218 INFO:teuthology.orchestra.run.smithi110.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-16T16:43:45.243 INFO:teuthology.orchestra.run.smithi110.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 713 kB/s | 18 kB 00:00 2024-09-16T16:43:45.268 INFO:teuthology.orchestra.run.smithi110.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 924 kB/s | 23 kB 00:00 2024-09-16T16:43:45.294 INFO:teuthology.orchestra.run.smithi110.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 775 kB/s | 19 kB 00:00 2024-09-16T16:43:45.319 INFO:teuthology.orchestra.run.smithi110.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 784 kB/s | 20 kB 00:00 2024-09-16T16:43:45.344 INFO:teuthology.orchestra.run.smithi110.stdout:(27/37): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 42 kB 00:00 2024-09-16T16:43:45.370 INFO:teuthology.orchestra.run.smithi110.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 938 kB/s | 46 kB 00:00 2024-09-16T16:43:45.420 INFO:teuthology.orchestra.run.smithi110.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-16T16:43:45.446 INFO:teuthology.orchestra.run.smithi110.stdout:(30/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.9 MB/s | 272 kB 00:00 2024-09-16T16:43:45.471 INFO:teuthology.orchestra.run.smithi110.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-16T16:43:45.504 INFO:teuthology.orchestra.run.smithi110.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-16T16:43:45.530 INFO:teuthology.orchestra.run.smithi110.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2024-09-16T16:43:45.563 INFO:teuthology.orchestra.run.smithi110.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-16T16:43:45.589 INFO:teuthology.orchestra.run.smithi110.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-16T16:43:45.622 INFO:teuthology.orchestra.run.smithi110.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-16T16:44:08.179 INFO:teuthology.orchestra.run.smithi110.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.6 MB/s | 70 MB 00:27 2024-09-16T16:44:08.184 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:08.184 INFO:teuthology.orchestra.run.smithi110.stdout:Total 2.7 MB/s | 84 MB 00:31 2024-09-16T16:44:08.334 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:44:08.375 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:44:08.375 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:44:09.167 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:44:09.167 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:44:10.842 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:44:10.898 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:44:10.922 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:44:10.950 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:44:11.023 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:44:11.066 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:44:11.098 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:44:11.199 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:44:11.303 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:44:11.349 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:44:11.384 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:44:11.414 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:44:11.440 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:44:11.473 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:44:11.514 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:44:11.557 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:44:11.592 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:44:11.641 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:44:11.672 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:44:11.746 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:44:11.894 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:44:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:44:12.034 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:44:12.081 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:44:12.138 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:44:12.193 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:44:12.390 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:44:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:44:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:44:12.618 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:44:12.663 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:44:12.799 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:44:12.988 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:44:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:44:13.045 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:13.045 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:44:13.045 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:13.045 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:44:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:23.646 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:23.675 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:44:23.675 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:23.675 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:44:23.675 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:23.676 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:44:23.676 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:24.214 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:24.238 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:44:24.238 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:24.238 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:44:24.238 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:24.238 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:44:24.238 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:24.481 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:24.505 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:44:24.505 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:24.505 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:44:24.505 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:24.505 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:44:24.505 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:24.569 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:44:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:44:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:44:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:44:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:44:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:44:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:44:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:44:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:44:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:44:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:44:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:44:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:44:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:44:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:44:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:44:31.331 INFO:teuthology.orchestra.run.smithi002.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 782 kB/s | 85 MB 01:50 2024-09-16T16:44:31.334 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:31.334 INFO:teuthology.orchestra.run.smithi002.stdout:Total 802 kB/s | 87 MB 01:51 2024-09-16T16:44:31.406 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:44:31.431 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:44:31.431 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:44:32.083 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:32.211 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:44:32.212 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:44:32.213 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:44:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:44:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:44:32.214 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:32.214 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:44:32.501 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-base 2024-09-16T16:44:33.020 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:44:33.063 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:03:16 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:44:33.098 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T16:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T16:44:33.152 INFO:teuthology.orchestra.run.smithi110.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:33.195 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T16:44:33.196 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:44:33.196 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:44:33.229 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T16:44:33.260 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:44:33.272 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install cephadm 2024-09-16T16:44:33.284 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:44:33.362 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T16:44:33.412 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T16:44:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:44:33.830 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:03:16 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:44:33.962 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:44:33.962 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 785 k 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 791 k 2024-09-16T16:44:33.963 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:44:34.730 INFO:teuthology.orchestra.run.smithi110.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 1.0 MB/s | 785 kB 00:00 2024-09-16T16:44:34.730 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:34.731 INFO:teuthology.orchestra.run.smithi110.stdout:Total 1.0 MB/s | 785 kB 00:00 2024-09-16T16:44:34.731 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:44:34.736 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:44:34.736 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:44:34.742 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:44:34.743 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:44:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:44:35.249 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:35.718 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:44:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:35.979 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:44:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:35.979 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:44:36.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:44:36.848 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:03:19 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:44:36.983 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:36.984 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 158 k 2024-09-16T16:44:36.985 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 644 k 2024-09-16T16:44:36.985 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:44:38.029 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 151 kB/s | 158 kB 00:01 2024-09-16T16:44:38.029 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:38.030 INFO:teuthology.orchestra.run.smithi110.stdout:Total 151 kB/s | 158 kB 00:01 2024-09-16T16:44:38.030 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:44:38.041 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:44:38.041 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:44:38.103 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:44:38.103 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:44:38.261 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:44:38.355 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:38.379 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:38.379 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:44:38.380 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:44:38.380 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:44:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:39.347 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:44:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:39.347 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:44:39.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr 2024-09-16T16:44:40.127 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:03:23 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:44:40.221 INFO:teuthology.orchestra.run.smithi110.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:44:40.264 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:44:40.265 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:44:40.265 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:44:40.346 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:44:40.910 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:03:23 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:44:41.045 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:44:41.046 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:44:41.047 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout:Install 11 Packages 2024-09-16T16:44:41.048 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:41.049 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 18 M 2024-09-16T16:44:41.049 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 155 M 2024-09-16T16:44:41.049 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:44:41.625 INFO:teuthology.orchestra.run.smithi110.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 106 kB/s | 34 kB 00:00 2024-09-16T16:44:41.650 INFO:teuthology.orchestra.run.smithi110.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 47 kB/s | 16 kB 00:00 2024-09-16T16:44:41.775 INFO:teuthology.orchestra.run.smithi110.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-09-16T16:44:41.834 INFO:teuthology.orchestra.run.smithi110.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T16:44:41.868 INFO:teuthology.orchestra.run.smithi110.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 580 kB/s | 19 kB 00:00 2024-09-16T16:44:41.985 INFO:teuthology.orchestra.run.smithi110.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 17 MB/s | 2.0 MB 00:00 2024-09-16T16:44:42.014 INFO:teuthology.orchestra.run.smithi110.stdout:(7/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.3 MB/s | 863 kB 00:00 2024-09-16T16:44:42.044 INFO:teuthology.orchestra.run.smithi110.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-16T16:44:42.077 INFO:teuthology.orchestra.run.smithi110.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 6.9 MB/s | 188 kB 00:00 2024-09-16T16:44:42.102 INFO:teuthology.orchestra.run.smithi110.stdout:(10/11): python3-repoze-lru-0.7-16.el9.noarch.r 351 kB/s | 31 kB 00:00 2024-09-16T16:44:45.019 INFO:teuthology.orchestra.run.smithi110.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 3.8 MB/s | 14 MB 00:03 2024-09-16T16:44:45.024 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:45.024 INFO:teuthology.orchestra.run.smithi110.stdout:Total 4.6 MB/s | 18 MB 00:03 2024-09-16T16:44:45.058 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:44:45.078 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:44:45.078 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:44:45.327 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:44:45.328 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:44:45.343 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T16:44:45.421 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:45.906 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:44:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:44:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:44:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:44:46.249 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:44:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:44:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:44:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:44:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:44:49.713 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:44:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:51.590 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T16:44:51.590 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T16:44:51.590 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T16:44:51.590 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T16:44:51.590 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T16:44:51.590 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T16:44:51.590 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T16:44:51.591 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T16:44:51.591 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T16:44:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:44:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:44:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:44:51.667 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:44:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:44:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:44:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:44:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:44:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:44:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:44:51.668 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:44:51.967 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:44:51.968 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:44:51.969 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:44:51.969 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:44:51.969 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:51.969 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:44:52.030 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T16:44:52.030 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:44:52.030 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:44:52.030 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:52.030 INFO:teuthology.orchestra.run.smithi002.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T16:44:52.030 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:44:52.030 INFO:teuthology.orchestra.run.smithi002.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T16:44:52.031 INFO:teuthology.orchestra.run.smithi002.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T16:44:52.031 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T16:44:52.031 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T16:44:52.031 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T16:44:52.031 INFO:teuthology.orchestra.run.smithi002.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T16:44:52.031 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:44:52.031 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:44:52.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:44:52.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph 2024-09-16T16:44:52.805 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:03:35 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:44:52.915 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:33 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:44:52.937 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:44:52.938 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:44:52.939 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout:Install 12 Packages 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:44:52.940 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 38 M 2024-09-16T16:44:52.941 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 212 M 2024-09-16T16:44:52.941 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:44:53.057 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:44:53.059 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:44:53.059 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:44:53.059 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:44:53.059 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:44:53.059 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T16:44:53.059 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T16:44:53.060 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T16:44:53.061 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout:Install 37 Packages 2024-09-16T16:44:53.062 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:44:53.063 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 84 M 2024-09-16T16:44:53.063 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 897 M 2024-09-16T16:44:53.063 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:44:53.152 INFO:teuthology.orchestra.run.smithi110.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-16T16:44:53.210 INFO:teuthology.orchestra.run.smithi110.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-16T16:44:53.260 INFO:teuthology.orchestra.run.smithi110.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-16T16:44:53.311 INFO:teuthology.orchestra.run.smithi110.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-16T16:44:53.361 INFO:teuthology.orchestra.run.smithi110.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-16T16:44:53.683 INFO:teuthology.orchestra.run.smithi002.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2024-09-16T16:44:54.117 INFO:teuthology.orchestra.run.smithi002.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 2.3 MB/s | 1.6 MB 00:00 2024-09-16T16:44:54.167 INFO:teuthology.orchestra.run.smithi002.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 2.9 MB/s | 2.2 MB 00:00 2024-09-16T16:44:54.225 INFO:teuthology.orchestra.run.smithi002.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 4.9 MB/s | 291 kB 00:00 2024-09-16T16:44:54.253 INFO:teuthology.orchestra.run.smithi110.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2024-09-16T16:44:54.368 INFO:teuthology.orchestra.run.smithi002.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-16T16:44:54.412 INFO:teuthology.orchestra.run.smithi110.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-16T16:44:54.434 INFO:teuthology.orchestra.run.smithi002.stdout:(6/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 6.8 MB/s | 5.1 MB 00:00 2024-09-16T16:44:54.501 INFO:teuthology.orchestra.run.smithi002.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 9.2 MB/s | 1.2 MB 00:00 2024-09-16T16:44:54.543 INFO:teuthology.orchestra.run.smithi002.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-16T16:44:54.569 INFO:teuthology.orchestra.run.smithi002.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 795 kB/s | 106 kB 00:00 2024-09-16T16:44:54.594 INFO:teuthology.orchestra.run.smithi002.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-16T16:44:54.644 INFO:teuthology.orchestra.run.smithi002.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-16T16:44:54.671 INFO:teuthology.orchestra.run.smithi110.stdout:(8/12): ceph-mgr-diskprediction-local-19.3.0-48 4.5 MB/s | 7.4 MB 00:01 2024-09-16T16:44:54.786 INFO:teuthology.orchestra.run.smithi002.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 983 kB/s | 188 kB 00:00 2024-09-16T16:44:54.837 INFO:teuthology.orchestra.run.smithi002.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 898 kB/s | 172 kB 00:00 2024-09-16T16:44:54.862 INFO:teuthology.orchestra.run.smithi002.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 462 kB/s | 35 kB 00:00 2024-09-16T16:44:54.887 INFO:teuthology.orchestra.run.smithi002.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-16T16:44:54.904 INFO:teuthology.orchestra.run.smithi002.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-16T16:44:54.912 INFO:teuthology.orchestra.run.smithi110.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 3.2 MB/s | 4.9 MB 00:01 2024-09-16T16:44:54.929 INFO:teuthology.orchestra.run.smithi002.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 997 kB/s | 42 kB 00:00 2024-09-16T16:44:54.938 INFO:teuthology.orchestra.run.smithi110.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 939 kB/s | 250 kB 00:00 2024-09-16T16:44:54.988 INFO:teuthology.orchestra.run.smithi002.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-16T16:44:55.005 INFO:teuthology.orchestra.run.smithi002.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.5 MB/s | 43 kB 00:00 2024-09-16T16:44:55.021 INFO:teuthology.orchestra.run.smithi002.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-16T16:44:55.064 INFO:teuthology.orchestra.run.smithi002.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-16T16:44:55.081 INFO:teuthology.orchestra.run.smithi002.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 739 kB/s | 11 kB 00:00 2024-09-16T16:44:55.106 INFO:teuthology.orchestra.run.smithi002.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 708 kB/s | 18 kB 00:00 2024-09-16T16:44:55.131 INFO:teuthology.orchestra.run.smithi002.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-09-16T16:44:55.157 INFO:teuthology.orchestra.run.smithi002.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 459 kB/s | 23 kB 00:00 2024-09-16T16:44:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-16T16:44:55.207 INFO:teuthology.orchestra.run.smithi002.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-16T16:44:55.232 INFO:teuthology.orchestra.run.smithi002.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-16T16:44:55.258 INFO:teuthology.orchestra.run.smithi002.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T16:44:55.283 INFO:teuthology.orchestra.run.smithi002.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 664 kB/s | 16 kB 00:00 2024-09-16T16:44:55.308 INFO:teuthology.orchestra.run.smithi002.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T16:44:55.334 INFO:teuthology.orchestra.run.smithi002.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-16T16:44:55.359 INFO:teuthology.orchestra.run.smithi002.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-16T16:44:55.384 INFO:teuthology.orchestra.run.smithi002.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T16:44:55.410 INFO:teuthology.orchestra.run.smithi002.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-09-16T16:44:55.443 INFO:teuthology.orchestra.run.smithi002.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-16T16:44:56.446 INFO:teuthology.orchestra.run.smithi110.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.5 MB/s | 5.1 MB 00:02 2024-09-16T16:44:57.694 INFO:teuthology.orchestra.run.smithi002.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 20 MB/s | 70 MB 00:03 2024-09-16T16:44:57.698 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:44:57.698 INFO:teuthology.orchestra.run.smithi002.stdout:Total 18 MB/s | 84 MB 00:04 2024-09-16T16:44:57.853 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:44:57.898 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:44:57.899 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:44:58.738 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:44:58.738 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:45:00.412 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:45:00.480 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T16:45:00.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T16:45:00.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T16:45:00.615 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T16:45:00.657 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T16:45:00.689 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T16:45:00.785 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T16:45:00.863 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T16:45:00.909 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T16:45:00.944 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T16:45:00.973 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T16:45:01.008 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T16:45:01.041 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T16:45:01.082 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T16:45:01.125 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T16:45:01.159 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T16:45:01.209 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T16:45:01.248 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T16:45:01.326 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T16:45:01.478 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T16:45:01.559 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T16:45:01.619 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T16:45:01.657 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T16:45:01.715 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T16:45:01.780 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T16:45:01.985 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T16:45:02.036 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T16:45:02.117 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T16:45:02.224 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T16:45:02.270 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T16:45:02.413 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T16:45:02.614 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T16:45:02.644 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:45:02.672 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T16:45:02.672 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:02.672 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T16:45:02.672 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:45:02.672 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T16:45:02.672 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:02.804 INFO:teuthology.orchestra.run.smithi110.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.1 MB/s | 16 MB 00:07 2024-09-16T16:45:02.805 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:02.806 INFO:teuthology.orchestra.run.smithi110.stdout:Total 3.9 MB/s | 38 MB 00:09 2024-09-16T16:45:03.163 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:03.188 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:03.189 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:03.623 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:03.623 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:04.378 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:04.471 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:04.511 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:04.610 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:04.645 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:04.829 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:04.853 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:04.929 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:05.572 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:05.691 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:06.901 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:07.962 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:10.999 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:10.999 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:10.999 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:10.999 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:10.999 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:10.999 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:11.000 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:11.433 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:12.010 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:03:55 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:12.143 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:12.145 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout:Install 13 Packages 2024-09-16T16:45:12.146 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:12.147 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 2.2 M 2024-09-16T16:45:12.147 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 26 M 2024-09-16T16:45:12.147 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:12.671 INFO:teuthology.orchestra.run.smithi110.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 286 kB/s | 26 kB 00:00 2024-09-16T16:45:12.696 INFO:teuthology.orchestra.run.smithi110.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 167 kB/s | 19 kB 00:00 2024-09-16T16:45:12.796 INFO:teuthology.orchestra.run.smithi110.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-16T16:45:12.822 INFO:teuthology.orchestra.run.smithi110.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-16T16:45:12.864 INFO:teuthology.orchestra.run.smithi110.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-09-16T16:45:12.889 INFO:teuthology.orchestra.run.smithi110.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 801 kB/s | 54 kB 00:00 2024-09-16T16:45:12.914 INFO:teuthology.orchestra.run.smithi110.stdout:(7/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 148 kB/s | 49 kB 00:00 2024-09-16T16:45:12.964 INFO:teuthology.orchestra.run.smithi110.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-16T16:45:12.990 INFO:teuthology.orchestra.run.smithi110.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-16T16:45:13.023 INFO:teuthology.orchestra.run.smithi110.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-16T16:45:13.049 INFO:teuthology.orchestra.run.smithi110.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.8 MB/s | 220 kB 00:00 2024-09-16T16:45:13.074 INFO:teuthology.orchestra.run.smithi110.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-16T16:45:13.124 INFO:teuthology.orchestra.run.smithi110.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.5 MB/s | 1.0 MB 00:00 2024-09-16T16:45:13.128 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:13.128 INFO:teuthology.orchestra.run.smithi110.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-16T16:45:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:13.207 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:13.207 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:13.293 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:13.294 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:13.919 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:13.947 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T16:45:13.947 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:13.947 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T16:45:13.947 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:13.948 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T16:45:13.948 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:13.971 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:14.025 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:14.081 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:14.118 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:14.160 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:14.261 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:14.372 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:14.428 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:14.536 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T16:45:14.561 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:14.561 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T16:45:14.561 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:14.561 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T16:45:14.561 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:14.804 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T16:45:14.829 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:14.829 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T16:45:14.829 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:14.829 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T16:45:14.829 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:14.895 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:15.135 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:15.184 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:15.218 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:15.266 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:15.288 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:45:16.110 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:45:16.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:45:16.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:45:16.111 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:45:16.473 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:45:16.474 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:45:16.475 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:45:16.475 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:45:16.475 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:16.475 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:16.742 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:45:17.309 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:00 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:17.442 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:17.443 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:17.443 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:45:17.443 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:17.443 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout:Install 6 Packages 2024-09-16T16:45:17.444 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:17.445 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 7.0 M 2024-09-16T16:45:17.445 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 33 M 2024-09-16T16:45:17.445 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:17.928 INFO:teuthology.orchestra.run.smithi110.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 358 kB/s | 154 kB 00:00 2024-09-16T16:45:18.012 INFO:teuthology.orchestra.run.smithi110.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-16T16:45:18.037 INFO:teuthology.orchestra.run.smithi110.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T16:45:18.070 INFO:teuthology.orchestra.run.smithi110.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-16T16:45:18.196 INFO:teuthology.orchestra.run.smithi110.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 355 kB/s | 248 kB 00:00 2024-09-16T16:45:19.629 INFO:teuthology.orchestra.run.smithi110.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.8 MB/s | 6.0 MB 00:02 2024-09-16T16:45:19.631 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:19.632 INFO:teuthology.orchestra.run.smithi110.stdout:Total 3.2 MB/s | 7.0 MB 00:02 2024-09-16T16:45:19.705 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:19.817 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:19.818 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:20.135 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:20.353 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:45:20.431 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:45:20.954 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:45:21.042 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:45:21.118 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:45:21.144 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:21.471 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T16:45:21.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T16:45:21.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T16:45:21.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T16:45:21.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T16:45:21.471 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T16:45:21.472 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T16:45:21.473 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T16:45:21.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T16:45:21.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T16:45:21.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T16:45:21.475 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T16:45:21.475 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T16:45:21.475 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T16:45:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:45:21.893 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:45:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:45:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:45:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:45:21.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:45:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:22.210 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T16:45:22.348 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T16:45:22.349 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T16:45:22.350 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T16:45:22.351 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T16:45:22.351 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T16:45:22.351 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T16:45:22.351 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T16:45:22.351 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:22.351 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:45:22.505 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-fuse 2024-09-16T16:45:22.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-base 2024-09-16T16:45:23.083 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:06 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:23.201 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:04 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:45:23.215 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:23.215 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout:Install 2 Packages 2024-09-16T16:45:23.216 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:23.217 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 964 k 2024-09-16T16:45:23.217 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 4.1 M 2024-09-16T16:45:23.217 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:23.294 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:23.339 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:45:23.340 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:45:23.340 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:45:23.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install cephadm 2024-09-16T16:45:23.658 INFO:teuthology.orchestra.run.smithi110.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 428 kB/s | 80 kB 00:00 2024-09-16T16:45:23.986 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:04 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:45:24.124 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:45:24.125 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:24.126 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 785 k 2024-09-16T16:45:24.126 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 791 k 2024-09-16T16:45:24.126 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:45:24.416 INFO:teuthology.orchestra.run.smithi110.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 936 kB/s | 884 kB 00:00 2024-09-16T16:45:24.431 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:24.431 INFO:teuthology.orchestra.run.smithi110.stdout:Total 803 kB/s | 964 kB 00:01 2024-09-16T16:45:24.431 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:24.457 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:24.457 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:24.540 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:24.541 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:24.885 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:45:24.902 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 1.0 MB/s | 785 kB 00:00 2024-09-16T16:45:24.903 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:24.903 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.0 MB/s | 785 kB 00:00 2024-09-16T16:45:24.903 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:45:24.910 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:45:24.910 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:45:24.917 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:45:24.917 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:45:24.957 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:24.997 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:45:25.471 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:25.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:45:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:45:25.914 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:45:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:25.915 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:45:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:25.915 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:26.127 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:45:26.127 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:26.127 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:26.127 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:45:26.212 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-volume 2024-09-16T16:45:26.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T16:45:26.788 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:09 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:26.924 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:26.925 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:26.926 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:45:26.926 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:26.926 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 285 k 2024-09-16T16:45:26.926 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 1.3 M 2024-09-16T16:45:26.926 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:26.937 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:07 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:45:27.075 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:45:27.076 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:27.077 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:45:27.077 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:27.077 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 158 k 2024-09-16T16:45:27.077 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 644 k 2024-09-16T16:45:27.077 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:45:27.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 463 kB/s | 158 kB 00:00 2024-09-16T16:45:27.419 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:27.419 INFO:teuthology.orchestra.run.smithi002.stdout:Total 461 kB/s | 158 kB 00:00 2024-09-16T16:45:27.419 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:45:27.430 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 566 kB/s | 285 kB 00:00 2024-09-16T16:45:27.431 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:45:27.431 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:45:27.431 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:27.431 INFO:teuthology.orchestra.run.smithi110.stdout:Total 564 kB/s | 285 kB 00:00 2024-09-16T16:45:27.431 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:27.439 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:27.439 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:27.470 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:27.470 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:27.491 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:45:27.492 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:45:27.653 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:45:27.690 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:27.736 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:27.763 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:27.763 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:27.764 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T16:45:27.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:27.765 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:27.781 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:27.781 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:45:27.781 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:28.737 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T16:45:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:28.738 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:45:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:28.738 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:28.738 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:45:28.790 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:45:28.790 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:28.790 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:28.790 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:28.790 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:28.790 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:28.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr 2024-09-16T16:45:29.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librados-devel 2024-09-16T16:45:29.562 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:10 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:45:29.655 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:29.668 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:12 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:29.700 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:45:29.701 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:45:29.701 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:45:29.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T16:45:29.807 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:29.808 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:29.808 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T16:45:29.808 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:29.808 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 125 k 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 445 k 2024-09-16T16:45:29.809 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:30.027 INFO:teuthology.orchestra.run.smithi110.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 573 kB/s | 125 kB 00:00 2024-09-16T16:45:30.028 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:30.028 INFO:teuthology.orchestra.run.smithi110.stdout:Total 569 kB/s | 125 kB 00:00 2024-09-16T16:45:30.028 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:30.033 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:30.033 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:30.098 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:30.098 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:30.262 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:30.343 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:11 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:45:30.366 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:30.482 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:45:30.483 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:30.483 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:45:30.483 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:30.483 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:45:30.483 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T16:45:30.483 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:45:30.484 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:Install 11 Packages 2024-09-16T16:45:30.485 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 18 M 2024-09-16T16:45:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 155 M 2024-09-16T16:45:30.485 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:45:30.793 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:31.031 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:31.031 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:31.031 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:31.303 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install libcephfs2 2024-09-16T16:45:31.338 INFO:teuthology.orchestra.run.smithi002.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 230 kB/s | 34 kB 00:00 2024-09-16T16:45:31.363 INFO:teuthology.orchestra.run.smithi002.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 95 kB/s | 16 kB 00:00 2024-09-16T16:45:31.547 INFO:teuthology.orchestra.run.smithi002.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.6 MB/s | 863 kB 00:00 2024-09-16T16:45:31.664 INFO:teuthology.orchestra.run.smithi002.stdout:(4/11): python3-protobuf-3.14.0-13.el9.noarch.r 828 kB/s | 269 kB 00:00 2024-09-16T16:45:31.706 INFO:teuthology.orchestra.run.smithi002.stdout:(5/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 3.4 MB/s | 548 kB 00:00 2024-09-16T16:45:31.739 INFO:teuthology.orchestra.run.smithi002.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-09-16T16:45:31.781 INFO:teuthology.orchestra.run.smithi002.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.4 MB/s | 144 kB 00:00 2024-09-16T16:45:31.806 INFO:teuthology.orchestra.run.smithi002.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T16:45:31.848 INFO:teuthology.orchestra.run.smithi002.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-16T16:45:31.884 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:14 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.8 MB/s | 2.0 MB 00:00 2024-09-16T16:45:31.976 INFO:teuthology.orchestra.run.smithi110.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:32.023 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:32.024 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:45:32.024 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:32.100 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install libcephfs-devel 2024-09-16T16:45:32.107 INFO:teuthology.orchestra.run.smithi002.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 15 MB/s | 14 MB 00:00 2024-09-16T16:45:32.112 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:32.112 INFO:teuthology.orchestra.run.smithi002.stdout:Total 11 MB/s | 18 MB 00:01 2024-09-16T16:45:32.145 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:45:32.166 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:45:32.166 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:45:32.439 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:45:32.440 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:45:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:15 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:32.805 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:32.805 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:32.805 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 32 k 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 142 k 2024-09-16T16:45:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:32.956 INFO:teuthology.orchestra.run.smithi110.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 212 kB/s | 32 kB 00:00 2024-09-16T16:45:32.957 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:32.957 INFO:teuthology.orchestra.run.smithi110.stdout:Total 210 kB/s | 32 kB 00:00 2024-09-16T16:45:32.957 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:32.961 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:32.961 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:32.977 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:32.978 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:33.002 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:45:33.067 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:33.098 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T16:45:33.136 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T16:45:33.162 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:33.228 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T16:45:33.359 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T16:45:33.415 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T16:45:33.502 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T16:45:33.547 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:33.558 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T16:45:33.586 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:33.619 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T16:45:33.780 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:33.780 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:33.780 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:33.780 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:33.780 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:33.780 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:33.982 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librados2 2024-09-16T16:45:34.547 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:17 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:34.637 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:34.680 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:34.681 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:45:34.681 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:34.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install librbd1 2024-09-16T16:45:35.323 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:18 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:35.412 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:35.455 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:35.456 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:45:35.457 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:35.534 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rados 2024-09-16T16:45:36.098 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:19 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:36.186 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:36.229 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:36.230 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:45:36.230 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:36.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rgw 2024-09-16T16:45:36.864 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:19 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:36.955 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:36.989 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T16:45:36.998 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:36.999 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:45:36.999 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:37.056 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:37.079 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-cephfs 2024-09-16T16:45:37.640 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:20 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:37.731 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:37.775 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:37.776 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:45:37.776 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:37.856 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install python3-rbd 2024-09-16T16:45:38.420 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:21 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:38.512 INFO:teuthology.orchestra.run.smithi110.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:45:38.556 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:38.557 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-16T16:45:38.557 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:38.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-fuse 2024-09-16T16:45:38.951 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T16:45:38.952 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T16:45:39.206 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:22 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:39.340 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:39.341 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:39.342 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:45:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:39.342 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 91 k 2024-09-16T16:45:39.342 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 321 k 2024-09-16T16:45:39.342 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T16:45:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:45:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T16:45:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:39.400 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:45:39.535 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 472 kB/s | 91 kB 00:00 2024-09-16T16:45:39.535 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:39.535 INFO:teuthology.orchestra.run.smithi110.stdout:Total 468 kB/s | 91 kB 00:00 2024-09-16T16:45:39.535 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:39.544 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:39.544 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:39.608 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:39.608 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:39.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T16:45:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:40.220 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:21 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:45:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T16:45:40.378 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:Install 12 Packages 2024-09-16T16:45:40.379 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 38 M 2024-09-16T16:45:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 212 M 2024-09-16T16:45:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:45:40.472 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:40.472 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:40.472 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:40.472 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:40.472 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:40.472 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:40.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-mirror 2024-09-16T16:45:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 878 kB/s | 191 kB 00:00 2024-09-16T16:45:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-16T16:45:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-16T16:45:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-16T16:45:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 927 kB/s | 38 kB 00:00 2024-09-16T16:45:41.366 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:24 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 14 MB/s | 7.4 MB 00:00 2024-09-16T16:45:41.506 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repo Size 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:45:41.507 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:41.508 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 3.5 M 2024-09-16T16:45:41.508 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 30 M 2024-09-16T16:45:41.508 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 753 kB/s | 245 kB 00:00 2024-09-16T16:45:41.863 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 9.9 MB/s | 3.5 MB 00:00 2024-09-16T16:45:41.864 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:41.865 INFO:teuthology.orchestra.run.smithi110.stdout:Total 9.8 MB/s | 3.5 MB 00:00 2024-09-16T16:45:41.865 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:41.876 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:41.876 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 3.0 MB 00:00 2024-09-16T16:45:41.959 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:41.959 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.5 MB/s | 250 kB 00:00 2024-09-16T16:45:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.5 MB/s | 4.9 MB 00:01 2024-09-16T16:45:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.3 MB/s | 5.1 MB 00:00 2024-09-16T16:45:42.623 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:42.648 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:42.648 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:45:42.648 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:45:42.649 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:45:42.649 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:45:42.649 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:43.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:43.903 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:43.903 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:43.903 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:43.903 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:43.904 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:44.163 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install rbd-nbd 2024-09-16T16:45:44.743 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:04:27 ago on Mon 16 Sep 2024 04:41:17 PM UTC. 2024-09-16T16:45:44.879 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-16T16:45:44.879 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:44.879 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:Install 1 Package 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 177 k 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 685 k 2024-09-16T16:45:44.880 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-16T16:45:45.093 INFO:teuthology.orchestra.run.smithi110.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 832 kB/s | 177 kB 00:00 2024-09-16T16:45:45.094 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:45.094 INFO:teuthology.orchestra.run.smithi110.stdout:Total 826 kB/s | 177 kB 00:00 2024-09-16T16:45:45.094 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-16T16:45:45.103 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-16T16:45:45.103 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-16T16:45:45.172 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-16T16:45:45.173 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-16T16:45:45.338 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-16T16:45:45.440 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:45.882 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:45:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:46.145 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-16T16:45:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:45:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:45:46.145 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-16T16:45:46.423 DEBUG:teuthology.parallel:result is None 2024-09-16T16:45:46.432 INFO:teuthology.orchestra.run.smithi002.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-16T16:45:46.434 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:46.434 INFO:teuthology.orchestra.run.smithi002.stdout:Total 6.3 MB/s | 38 MB 00:06 2024-09-16T16:45:46.807 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:45:46.835 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:45:46.835 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:45:47.289 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:45:47.289 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:45:48.206 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:45:48.282 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T16:45:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:48.428 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:48.482 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T16:45:48.675 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T16:45:48.705 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T16:45:48.785 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T16:45:49.485 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T16:45:49.605 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T16:45:50.898 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:51.993 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T16:45:52.021 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T16:45:54.562 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T16:45:54.563 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T16:45:54.992 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:54.993 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:45:55.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-rook 2024-09-16T16:45:56.042 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:37 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:45:56.185 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T16:45:56.186 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:45:56.187 INFO:teuthology.orchestra.run.smithi002.stdout:Install 13 Packages 2024-09-16T16:45:56.188 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:45:56.188 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.2 M 2024-09-16T16:45:56.188 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 26 M 2024-09-16T16:45:56.188 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:45:56.588 INFO:teuthology.orchestra.run.smithi002.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 310 kB/s | 26 kB 00:00 2024-09-16T16:45:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 178 kB/s | 19 kB 00:00 2024-09-16T16:45:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-16T16:45:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:(4/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 236 kB/s | 49 kB 00:00 2024-09-16T16:45:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-16T16:45:56.781 INFO:teuthology.orchestra.run.smithi002.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.9 MB/s | 279 kB 00:00 2024-09-16T16:45:56.806 INFO:teuthology.orchestra.run.smithi002.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 799 kB/s | 54 kB 00:00 2024-09-16T16:45:56.840 INFO:teuthology.orchestra.run.smithi002.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-16T16:45:56.874 INFO:teuthology.orchestra.run.smithi002.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-09-16T16:45:56.907 INFO:teuthology.orchestra.run.smithi002.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-09-16T16:45:56.949 INFO:teuthology.orchestra.run.smithi002.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 10 MB/s | 1.0 MB 00:00 2024-09-16T16:45:56.974 INFO:teuthology.orchestra.run.smithi002.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-16T16:45:56.999 INFO:teuthology.orchestra.run.smithi002.stdout:(13/13): python3-google-auth-2.34.0-1.el9.noarc 1.2 MB/s | 220 kB 00:00 2024-09-16T16:45:57.002 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:45:57.002 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-16T16:45:57.068 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:45:57.084 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:45:57.085 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:45:57.182 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:45:57.184 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:45:57.702 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:45:57.880 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T16:45:57.950 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T16:45:58.084 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T16:45:58.119 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T16:45:58.161 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T16:45:58.275 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T16:45:58.385 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T16:45:58.438 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T16:45:59.224 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T16:45:59.276 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T16:45:59.309 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T16:45:59.358 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T16:45:59.387 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:46:00.040 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T16:46:00.040 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T16:46:00.041 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T16:46:00.388 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T16:46:00.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T16:46:00.389 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T16:46:00.390 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T16:46:00.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:00.390 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:00.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T16:46:01.241 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:42 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:01.380 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:01.381 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:01.381 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:46:01.381 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:01.381 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:01.381 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2024-09-16T16:46:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:01.383 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 7.0 M 2024-09-16T16:46:01.383 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 33 M 2024-09-16T16:46:01.383 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:01.776 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-16T16:46:01.801 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 697 kB/s | 154 kB 00:00 2024-09-16T16:46:01.859 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 989 kB/s | 58 kB 00:00 2024-09-16T16:46:01.893 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-16T16:46:01.918 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.8 MB/s | 548 kB 00:00 2024-09-16T16:46:02.227 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.2 MB/s | 6.0 MB 00:00 2024-09-16T16:46:02.229 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:02.230 INFO:teuthology.orchestra.run.smithi002.stdout:Total 8.3 MB/s | 7.0 MB 00:00 2024-09-16T16:46:02.303 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:02.315 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:02.315 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:02.421 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:02.422 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:02.849 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:03.035 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T16:46:03.105 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T16:46:03.674 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T16:46:03.770 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T16:46:03.845 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T16:46:03.874 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:46:04.636 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T16:46:04.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T16:46:04.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T16:46:04.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T16:46:04.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T16:46:04.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T16:46:04.946 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T16:46:04.946 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:04.946 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:04.946 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:46:04.946 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T16:46:04.946 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T16:46:04.947 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T16:46:04.947 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T16:46:04.947 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T16:46:04.947 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:04.947 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:05.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-fuse 2024-09-16T16:46:05.781 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:46 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:05.922 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T16:46:05.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:05.924 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:05.924 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:05.924 INFO:teuthology.orchestra.run.smithi002.stdout:Install 2 Packages 2024-09-16T16:46:05.924 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:05.924 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 964 k 2024-09-16T16:46:05.924 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 4.1 M 2024-09-16T16:46:05.924 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:06.062 INFO:teuthology.orchestra.run.smithi002.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 698 kB/s | 80 kB 00:00 2024-09-16T16:46:06.212 INFO:teuthology.orchestra.run.smithi002.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.3 MB/s | 884 kB 00:00 2024-09-16T16:46:06.213 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:06.213 INFO:teuthology.orchestra.run.smithi002.stdout:Total 3.3 MB/s | 964 kB 00:00 2024-09-16T16:46:06.225 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:06.251 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:06.251 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:06.337 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:06.337 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:06.531 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:06.678 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T16:46:06.757 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:46:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T16:46:07.435 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T16:46:07.745 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T16:46:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T16:46:07.746 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:07.746 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:08.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-volume 2024-09-16T16:46:08.644 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:49 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:08.784 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:08.785 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:08.785 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-16T16:46:08.785 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:08.785 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 285 k 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 1.3 M 2024-09-16T16:46:08.786 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:09.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-16T16:46:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-16T16:46:09.001 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:09.010 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:09.010 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:09.044 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:09.045 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:09.277 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:09.352 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:46:09.370 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:46:09.370 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:46:09.370 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T16:46:09.370 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:10.369 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T16:46:10.369 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:10.370 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:10.370 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T16:46:10.370 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:10.370 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:10.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados-devel 2024-09-16T16:46:11.258 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:52 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:11.398 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:11.399 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 125 k 2024-09-16T16:46:11.400 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 445 k 2024-09-16T16:46:11.400 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:11.772 INFO:teuthology.orchestra.run.smithi002.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 335 kB/s | 125 kB 00:00 2024-09-16T16:46:11.772 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:11.772 INFO:teuthology.orchestra.run.smithi002.stdout:Total 334 kB/s | 125 kB 00:00 2024-09-16T16:46:11.772 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:11.778 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:11.779 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:12.845 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:12.845 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:12.845 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:13.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs2 2024-09-16T16:46:13.648 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:54 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:13.743 INFO:teuthology.orchestra.run.smithi002.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:13.791 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:13.792 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:46:13.792 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:13.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs-devel 2024-09-16T16:46:14.445 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:55 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:14.585 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 32 k 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 142 k 2024-09-16T16:46:14.586 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:14.733 INFO:teuthology.orchestra.run.smithi002.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 216 kB/s | 32 kB 00:00 2024-09-16T16:46:14.734 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:14.734 INFO:teuthology.orchestra.run.smithi002.stdout:Total 214 kB/s | 32 kB 00:00 2024-09-16T16:46:14.734 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:14.738 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:14.738 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:14.752 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:14.752 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:14.847 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:14.958 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.316 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.568 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:15.568 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:15.568 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:15.568 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:15.568 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:15.568 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:15.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados2 2024-09-16T16:46:16.345 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:57 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:16.438 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:16.485 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:16.486 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:46:16.486 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:16.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librbd1 2024-09-16T16:46:17.142 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:58 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:17.235 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:17.282 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:17.283 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:46:17.283 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:17.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rados 2024-09-16T16:46:17.932 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:58 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:18.028 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:18.075 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:46:18.076 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:18.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rgw 2024-09-16T16:46:18.729 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:04:59 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:18.823 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:18.869 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:18.870 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:46:18.871 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:18.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-cephfs 2024-09-16T16:46:19.522 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:05:00 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:19.615 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:19.661 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:19.663 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:46:19.663 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:19.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rbd 2024-09-16T16:46:20.329 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:05:01 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:20.424 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T16:46:20.470 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:20.471 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-16T16:46:20.471 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:20.530 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-fuse 2024-09-16T16:46:21.124 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:05:02 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:21.264 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:21.265 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 91 k 2024-09-16T16:46:21.266 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 321 k 2024-09-16T16:46:21.266 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 235 kB/s | 91 kB 00:00 2024-09-16T16:46:21.653 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:Total 234 kB/s | 91 kB 00:00 2024-09-16T16:46:21.654 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:21.664 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:21.664 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:21.731 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:21.732 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:21.881 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:22.004 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:22.413 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:22.686 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:22.686 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:22.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-mirror 2024-09-16T16:46:23.582 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:05:04 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:46:23.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 3.5 M 2024-09-16T16:46:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 30 M 2024-09-16T16:46:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:24.065 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-16T16:46:24.065 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:24.066 INFO:teuthology.orchestra.run.smithi002.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-16T16:46:24.066 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:24.079 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:24.079 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:24.168 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:24.168 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:24.798 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:24.849 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:24.877 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:24.877 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T16:46:24.877 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T16:46:24.877 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:24.877 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T16:46:24.877 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:26.177 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:26.177 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:26.177 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:26.177 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:26.178 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:26.178 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:26.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-nbd 2024-09-16T16:46:27.020 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:05:08 ago on Mon 16 Sep 2024 04:41:19 PM UTC. 2024-09-16T16:46:27.159 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-16T16:46:27.159 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-16T16:46:27.160 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-16T16:46:27.161 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:27.161 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 177 k 2024-09-16T16:46:27.161 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 685 k 2024-09-16T16:46:27.161 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-16T16:46:27.377 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 817 kB/s | 177 kB 00:00 2024-09-16T16:46:27.377 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-16T16:46:27.378 INFO:teuthology.orchestra.run.smithi002.stdout:Total 812 kB/s | 177 kB 00:00 2024-09-16T16:46:27.378 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-16T16:46:27.388 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-16T16:46:27.388 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-16T16:46:27.463 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-16T16:46:27.464 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-16T16:46:27.643 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-16T16:46:27.752 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:28.161 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:28.434 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T16:46:28.434 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:28.434 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-16T16:46:28.434 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T16:46:28.434 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:28.434 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-16T16:46:28.683 DEBUG:teuthology.parallel:result is None 2024-09-16T16:46:28.683 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:28.824 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:28.846 INFO:teuthology.orchestra.run.smithi002.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:28.847 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:28.847 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:28.848 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T16:46:28.987 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T16:46:29.012 INFO:teuthology.orchestra.run.smithi110.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:29.013 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T16:46:29.013 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T16:46:29.014 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T16:46:29.014 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:29.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:29.041 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:29.041 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T16:46:29.083 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T16:46:29.083 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:29.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:29.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:29.175 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:29.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T16:46:29.203 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T16:46:29.272 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T16:46:29.272 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:29.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:29.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:29.364 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:29.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T16:46:29.392 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T16:46:29.460 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T16:46:29.460 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:29.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:29.486 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:29.552 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:29.552 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T16:46:29.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T16:46:29.642 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T16:46:29.720 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T16:46:29.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:29.723 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-09-16T16:46:29.748 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T16:46:29.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:29.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T16:46:29.818 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T16:46:29.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:29.855 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T16:46:29.892 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T16:46:29.892 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T16:46:29.892 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency}', 'email': None, 'first_in_suite': False, 'job_id': '7907394', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6678, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO2fj11SKcdf6MBfev2iOTi3n348lroWshIePSP9iplYCZ8M36a3Z+E0Kdrm2tgcLkvripK6Z1Wgcs/3K2vmYx8=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECqSDjKTRhi4j0Cg88trN0g6oVs/boTwKvIS4E9bmirDlDwJkNExS9INzaYvPsSCHhrgljpuemOjk2d+755GCs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_16:23:48', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T16:46:29.893 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:29.922 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T16:46:29.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:29.977 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T16:46:30.004 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:30.004 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:30.057 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:30.058 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:30.114 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:30.114 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T16:46:30.114 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:30.114 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:30.115 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-16 16:46:25.135451584 +0000 2024-09-16T16:46:30.115 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-16 16:40:37.477603541 +0000 2024-09-16T16:46:30.115 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-16 16:40:37.477603541 +0000 2024-09-16T16:46:30.115 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-16 16:40:37.477603541 +0000 2024-09-16T16:46:30.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:30.179 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-16T16:46:30.179 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-16T16:46:30.179 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.0311e-05 s, 5.7 MB/s 2024-09-16T16:46:30.180 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:30.237 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:30.293 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:30.293 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:30.293 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T16:46:30.293 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:30.293 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:30.293 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-16 16:46:25.136451562 +0000 2024-09-16T16:46:30.293 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-16 16:40:37.801596626 +0000 2024-09-16T16:46:30.294 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-16 16:40:37.801596626 +0000 2024-09-16T16:46:30.294 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-16 16:40:37.801596626 +0000 2024-09-16T16:46:30.294 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:30.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-16T16:46:30.357 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-16T16:46:30.357 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000106159 s, 4.8 MB/s 2024-09-16T16:46:30.358 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:30.415 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-16 16:46:25.136451562 +0000 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-16 16:40:38.127589668 +0000 2024-09-16T16:46:30.471 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-16 16:40:38.127589668 +0000 2024-09-16T16:46:30.472 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-16 16:40:38.127589668 +0000 2024-09-16T16:46:30.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:30.535 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-16T16:46:30.535 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-16T16:46:30.536 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000104912 s, 4.9 MB/s 2024-09-16T16:46:30.537 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:30.594 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:30.649 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-16 16:46:25.137451540 +0000 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-16 16:40:38.459582583 +0000 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-16 16:40:38.459582583 +0000 2024-09-16T16:46:30.650 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-16 16:40:38.459582583 +0000 2024-09-16T16:46:30.650 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:30.713 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-16T16:46:30.714 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-16T16:46:30.714 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000101927 s, 5.0 MB/s 2024-09-16T16:46:30.715 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:30.771 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:30.772 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:30.772 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T16:46:30.788 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T16:46:30.788 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-16T16:46:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T16:46:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:30.843 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T16:46:30.843 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:30.843 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:30.844 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 16:45:42.908042700 +0000 2024-09-16T16:46:30.844 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 16:40:37.404813676 +0000 2024-09-16T16:46:30.844 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 16:40:37.404813676 +0000 2024-09-16T16:46:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 16:40:37.404813676 +0000 2024-09-16T16:46:30.844 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T16:46:30.907 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T16:46:30.907 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T16:46:30.907 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 8.3627e-05 s, 6.1 MB/s 2024-09-16T16:46:30.908 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T16:46:30.964 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 16:45:42.908042700 +0000 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 16:40:37.725807900 +0000 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 16:40:37.725807900 +0000 2024-09-16T16:46:31.019 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 16:40:37.725807900 +0000 2024-09-16T16:46:31.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T16:46:31.082 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T16:46:31.082 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T16:46:31.082 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.9482e-05 s, 5.1 MB/s 2024-09-16T16:46:31.083 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T16:46:31.140 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-16T16:46:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T16:46:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:31.195 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T16:46:31.195 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:31.195 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:31.195 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 16:45:42.908042700 +0000 2024-09-16T16:46:31.196 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 16:40:38.029802431 +0000 2024-09-16T16:46:31.196 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 16:40:38.029802431 +0000 2024-09-16T16:46:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 16:40:38.029802431 +0000 2024-09-16T16:46:31.196 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T16:46:31.258 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T16:46:31.258 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T16:46:31.258 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 7.691e-05 s, 6.7 MB/s 2024-09-16T16:46:31.259 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T16:46:31.315 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-16 16:45:42.909042682 +0000 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-16 16:40:38.347796710 +0000 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-16 16:40:38.347796710 +0000 2024-09-16T16:46:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-16 16:40:38.347796710 +0000 2024-09-16T16:46:31.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T16:46:31.432 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-16T16:46:31.432 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-16T16:46:31.432 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000101476 s, 5.0 MB/s 2024-09-16T16:46:31.434 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T16:46:31.489 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:31.490 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:31.490 INFO:tasks.ceph:Generating config... 2024-09-16T16:46:31.491 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T16:46:31.491 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T16:46:31.491 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T16:46:31.491 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T16:46:31.491 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T16:46:31.491 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T16:46:31.491 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T16:46:31.492 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-16T16:46:31.492 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-16T16:46:31.492 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-16T16:46:31.492 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-16T16:46:31.492 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:31.492 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T16:46:31.492 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T16:46:31.492 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T16:46:31.493 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T16:46:31.493 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T16:46:31.493 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T16:46:31.493 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-16T16:46:31.493 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T16:46:31.493 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T16:46:31.494 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T16:46:31.494 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-16T16:46:31.494 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-16T16:46:31.494 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-16T16:46:31.494 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-16T16:46:31.494 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T16:46:31.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:31.557 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T16:46:31.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T16:46:31.616 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:31.642 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2')] 2024-09-16T16:46:31.642 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-16T16:46:31.643 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:31.643 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:31.698 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:31.790+0000 7f72d1e58f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:31.790+0000 7f72d1e58f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:31.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:31.791+0000 7f72d1e58f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid c4016161-76cd-4174-ba7b-1295c2a4f0b9 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:fsid c4016161-76cd-4174-ba7b-1295c2a4f0b9 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-09-16T16:46:31.792216+0000 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-16T16:46:31.792216+0000 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 17 (quincy) 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-09-16T16:46:31.792 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-16T16:46:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T16:46:31.794 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T16:46:31.809 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c4016161-76cd-4174-ba7b-1295c2a4f0b9... 2024-09-16T16:46:31.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:31.852 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T16:46:31.894 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-16T16:46:31.894 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-09-16T16:46:31.894 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:31.894 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-09-16T16:46:31.894 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.894 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-09-16T16:46:31.894 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.895 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:31.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = 172.21.15.2 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: ms client mode = crc 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: ms cluster mode = crc 2024-09-16T16:46:31.897 INFO:teuthology.orchestra.run.smithi002.stdout: ms mon client mode = crc 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: ms mon cluster mode = crc 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: ms mon service mode = crc 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: ms service mode = crc 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_min_size = 2 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_size = 3 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = c4016161-76cd-4174-ba7b-1295c2a4f0b9 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 120 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.898 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.899 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: debug monc = 20 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-16T16:46:31.900 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug reject backfill probability = 0.3 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd delete sleep = 1 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd max backfills = 3 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd max markdown count = 1000 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = seastore 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub min interval = 60 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: osd snap trim sleep = 2 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-09-16T16:46:31.901 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mgr stats period = 30 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:31.902 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:31.903 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default crimson = True 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: paxos service trim min = 10 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:31.904 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout: debug objecter = 20 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout: debug rados = 20 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-09-16T16:46:31.905 INFO:teuthology.orchestra.run.smithi002.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-09-16T16:46:31.906 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.907 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.908 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = 172.21.15.2 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: ms client mode = crc 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: ms cluster mode = crc 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: ms mon client mode = crc 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: ms mon cluster mode = crc 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: ms mon service mode = crc 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: ms service mode = crc 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_min_size = 2 2024-09-16T16:46:31.909 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_size = 3 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = c4016161-76cd-4174-ba7b-1295c2a4f0b9 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 120 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-09-16T16:46:31.910 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.911 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: debug monc = 20 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: crimson osd obc lru size = 10 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd blocked scrub grace period = 3600 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug reject backfill probability = 0.3 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd delete sleep = 1 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd max backfills = 3 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd max markdown count = 1000 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = seastore 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub min interval = 60 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd shutdown pgref assert = True 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: osd snap trim sleep = 2 2024-09-16T16:46:31.912 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: mgr stats period = 30 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-16T16:46:31.913 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-09-16T16:46:31.914 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: mon min osdmap epochs = 50 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: mon osdmap full prune interval = 2 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: mon osdmap full prune min = 15 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: mon osdmap full prune txsize = 2 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default crimson = True 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: paxos service trim min = 10 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-09-16T16:46:31.915 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout: debug objecter = 20 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout: debug rados = 20 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout: crimson seastar cpu cores = 0-2 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-09-16T16:46:31.916 INFO:teuthology.orchestra.run.smithi110.stdout: crimson seastar cpu cores = 3-5 2024-09-16T16:46:31.918 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T16:46:31.918 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T16:46:32.024 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T16:46:32.025 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:32.025 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T16:46:32.041 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:32.041 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T16:46:32.096 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-09-16T16:46:32.096 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:32.097 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:32.097 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:32.171 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:32.171 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:32.227 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T16:46:32.228 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:32.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T16:46:32.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T16:46:32.264 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:32.264 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:32.320 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T16:46:32.320 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T16:46:32.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:32.429 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T16:46:32.432 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T16:46:32.432 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T16:46:32.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:32.483 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T16:46:32.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:32.548 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T16:46:32.561 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T16:46:32.561 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T16:46:32.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:32.587 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:32.587 INFO:tasks.ceph:role: osd.0 2024-09-16T16:46:32.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-16T16:46:32.587 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:32.653 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:32.686 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-16T16:46:32.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-16T16:46:32.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:32.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:32.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:32.900 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:32.900 INFO:tasks.ceph:role: osd.1 2024-09-16T16:46:32.900 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-16T16:46:32.900 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:32.965 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:32.966 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:32.966 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:32.998 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-16T16:46:33.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-16T16:46:33.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:33.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:33.143 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:33.456 INFO:teuthology.orchestra.run.smithi002.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:33.457 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:33,458 seastar - Reactor backend: linux-aio 2024-09-16T16:46:33.469 INFO:teuthology.orchestra.run.smithi002.stderr:==27877==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:33.578 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5fea886 0x5ff2466 0x5ff252b 0x60387d1 0x60389d9 0x6038bb9 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:33.578 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:33.597 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:33,598 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:33.597 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:33,598 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:33.598 INFO:teuthology.orchestra.run.smithi002.stderr:DEBUG 2024-09-16 16:46:33,599 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:34.142 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:34.143 INFO:teuthology.orchestra.run.smithi002.stderr:Suppressions used: 2024-09-16T16:46:34.143 INFO:teuthology.orchestra.run.smithi002.stderr: count bytes template 2024-09-16T16:46:34.143 INFO:teuthology.orchestra.run.smithi002.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:34.143 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:34.143 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T16:46:34.198 INFO:teuthology.orchestra.run.smithi002.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:34.202 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:34,203 seastar - Reactor backend: linux-aio 2024-09-16T16:46:34.212 INFO:teuthology.orchestra.run.smithi002.stderr:==27875==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797a 0xc9d97 0x36084f8 0x3b8c080 0x3b8c278 0xb9e9267 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xba022df 0xba313d1 0xba31a18 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3b8c199 0x3b8c278 0xb9effcb 0xb9f0280 0xb9d8651 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.543 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xc91c5 0xc9e39 0x360af6a 0x36e228a 0xba21b57 0xba21dd8 0xba21f8e 0xba220db 0xb9ca77e 0xb9cee31 0x9843791 0x9af9f5a 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.543 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.567 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4b268 0x3b8c0f7 0x3b8c278 0xb9e9267 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xb9ec717 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9ab25f7 0x9afe286 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.567 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.567 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3768de7 0x9636f4c 0xba1c574 0xba1c790 0xb9ca6d8 0x9ab2637 0x9afe0f2 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.567 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab8f 0x5c90278 0xb9ea6f5 0xb9ea95c 0xba02054 0xba313d1 0xba31a18 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.641 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x377a72b 0x3ac7a88 0x3b8c26d 0xb9fdc0e 0xba39123 0xba394ae 0xb9d98a8 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.641 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.641 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 66 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb853722 0xb853df6 0xb853f61 0xb85436c 0xb85462b 0xb9dab79 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.641 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5c90201 0xb9ea7a2 0xb9ea95c 0xb9ec717 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb9ec5cb 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33944 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.777 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4abc8 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.777 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542396 0x9e3396e 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55420e4 0x9e33959 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 230 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33934 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:Suppressions used: 2024-09-16T16:46:36.185 INFO:teuthology.orchestra.run.smithi002.stderr: count bytes template 2024-09-16T16:46:36.185 INFO:teuthology.orchestra.run.smithi002.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:36.185 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:36.185 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T16:46:36.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T16:46:36.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:36.531 INFO:teuthology.orchestra.run.smithi002.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:36.532 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:36,533 seastar - Reactor backend: linux-aio 2024-09-16T16:46:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:==27924==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x1254b8 0x10a2b9 0xfd59e 0x361b453 0x361b65c 0x362a2bb 0x382b1d8 0x416dc9b 0x5fb8ce4 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:36.666 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:36,666 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:36.666 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:36,666 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:36.667 INFO:teuthology.orchestra.run.smithi002.stderr:DEBUG 2024-09-16 16:46:36,667 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:37.198 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:37.198 INFO:teuthology.orchestra.run.smithi002.stderr:Suppressions used: 2024-09-16T16:46:37.198 INFO:teuthology.orchestra.run.smithi002.stderr: count bytes template 2024-09-16T16:46:37.198 INFO:teuthology.orchestra.run.smithi002.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:37.198 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:37.198 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T16:46:37.251 INFO:teuthology.orchestra.run.smithi002.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:37.255 INFO:teuthology.orchestra.run.smithi002.stderr:INFO 2024-09-16 16:46:37,256 seastar - Reactor backend: linux-aio 2024-09-16T16:46:37.265 INFO:teuthology.orchestra.run.smithi002.stderr:==27922==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5f85b8f 0x5fe9e38 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.564 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9af965f 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.564 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x377a58c 0x3ac7aa5 0x3b8c26d 0xb9e9267 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xba022df 0xba313d1 0xba31a18 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.564 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.564 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x42198 0x3ef7b 0xfd531 0xb85348d 0xb853540 0xb853656 0xb853736 0xb8539b6 0xb853f61 0xb85436c 0xb85462b 0xba26389 0xba28397 0xba2861f 0xba286cf 0xb9d809d 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff8716e98b 0xffffffff8721c582 0xffffffff8721c657 0xffffffff871ab284 0xffffffff8718e2b2 0xffffffff87196a3b 0xffffffff87196ebc 0xffffffff86e8c884 0xffffffff87ad1d62 0xffffffff87c00bb2 2024-09-16T16:46:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xff32f 0x42250 0x3ecea 0xfc9b1 0x386a219 0xb854a53 0xba25db6 0xb9caf71 0x9ab2569 0x9afe0f2 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.621 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c2b 0xdd332 0x4ab1c 0xb9e9103 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xb9ecf27 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9ab25f7 0x9afe0f2 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.622 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xc9232 0xc9e39 0x36084f8 0x3b8c080 0x3b8c278 0xb9e9267 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xba31cb1 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.697 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xba202dc 0xba2ad3d 0xba2af09 0xb9d1fe5 0xb9d2514 0xb9d84d7 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.697 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.697 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3b8bfe6 0x3b8c278 0xb9e909a 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xba31cb1 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.697 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.755 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797f 0xc6614 0x387d749 0x9afad0c 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.755 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.755 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x124ecc 0x421f3 0x3ef7b 0xfd531 0xb85348d 0xb853540 0xb853656 0xb853736 0xb8539b6 0xb853a6f 0xb853f61 0xb85436c 0xb85462b 0xb8550e8 0xba25db6 0xb9caf71 0x9afad98 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.755 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.775 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10d778 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:37.775 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x55422bd 0x9e3396e 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:37.833 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9e33934 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133c64 0xdd332 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:kernel callstack: 2024-09-16T16:46:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:Suppressions used: 2024-09-16T16:46:39.278 INFO:teuthology.orchestra.run.smithi002.stderr: count bytes template 2024-09-16T16:46:39.278 INFO:teuthology.orchestra.run.smithi002.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:----------------------------------------------------- 2024-09-16T16:46:39.278 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T16:46:39.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T16:46:39.331 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:39.361 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:39.361 INFO:tasks.ceph:role: osd.2 2024-09-16T16:46:39.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T16:46:39.361 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T16:46:39.430 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:39.430 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:39.430 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:39.430 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:39.430 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:39.430 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:39.431 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:39.431 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:39.431 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:39.431 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:39.463 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-16T16:46:39.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-16T16:46:39.465 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:39.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:39.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:39.674 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T16:46:39.675 INFO:tasks.ceph:role: osd.3 2024-09-16T16:46:39.675 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T16:46:39.675 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T16:46:39.739 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T16:46:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T16:46:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T16:46:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T16:46:39.739 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T16:46:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-16T16:46:39.740 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T16:46:39.740 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T16:46:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T16:46:39.740 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T16:46:39.771 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-16T16:46:39.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-16T16:46:39.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:39.842 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:39.909 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:40.202 INFO:teuthology.orchestra.run.smithi110.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:40.203 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:40,203 seastar - Reactor backend: linux-aio 2024-09-16T16:46:40.219 INFO:teuthology.orchestra.run.smithi110.stderr:==27594==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:40.342 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:40,343 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:40.343 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:40,343 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T16:46:40.343 INFO:teuthology.orchestra.run.smithi110.stderr:DEBUG 2024-09-16 16:46:40,344 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:40.870 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:40.871 INFO:teuthology.orchestra.run.smithi110.stderr:Suppressions used: 2024-09-16T16:46:40.871 INFO:teuthology.orchestra.run.smithi110.stderr: count bytes template 2024-09-16T16:46:40.871 INFO:teuthology.orchestra.run.smithi110.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:40.871 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:40.871 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-16T16:46:40.928 INFO:teuthology.orchestra.run.smithi110.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:40.932 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:40,933 seastar - Reactor backend: linux-aio 2024-09-16T16:46:40.942 INFO:teuthology.orchestra.run.smithi110.stderr:==27592==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:41.032 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5e1918a 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:41.032 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.175 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4aaff 0x3613f13 0x362a214 0x382b1d8 0x4550650 0xb9d216a 0xb9d2514 0xb9d84d7 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96a9bec 0x96a9f88 0x96aa10d 0x96aa1af 0x96aa2c8 0xbe45609 0xbe45810 0xbe458e6 0xbe45a21 0xbe45e15 0xbe451d8 0xbe452b8 0xbe453cc 0xbe4508f 0x9507f90 0x95ecfd2 0x9324493 0x932466d 0x93247a8 0x9324862 0x932493c 0x9324e88 0x9325160 0x9325215 0x959c95c 0x959cbc1 0x95cadf8 0x96ce5a6 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:41.175 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.226 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4473f 0xfb4fb 0x3768eab 0xb9ceb6e 0x9843791 0x9af9f5a 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.226 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.226 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xc923e 0xc9e39 0x36084f8 0x3b8c080 0x3b8c278 0xba0511f 0xba33d3f 0xba34389 0xb9ceb14 0x9843791 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.226 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.259 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xba26e3f 0xba27414 0xba2757f 0xba27a41 0xb9cbb89 0xba283d8 0xba2861f 0xba286cf 0xb9d809d 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:41.259 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.283 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x980e922 0x984368f 0x9e10dcb 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.283 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.284 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x611237b 0x6114432 0x6114527 0x61147af 0xba3480f 0xba34940 0xba34b2c 0xba34cc8 0xba3505e 0xba35270 0xb9d20ef 0xb9d2514 0xb9d9f7f 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9e12036 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.284 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.317 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xfb439 0x386a219 0xb853072 0xb8531ba 0xb8532a3 0xb853563 0xba26c65 0xba26d54 0xba26fd4 0xba2757f 0xba27a41 0xb9cbb89 0xba283d8 0xba2861f 0xba286cf 0xb9d809d 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:41.317 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.351 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb9ec6a9 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.351 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.351 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 66 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xff4d1 0x444e9 0xfe5da 0x5cc3466 0x5cc3640 0x5cc38f7 0x5cc38bc 0x5cc39ec 0xba1cab4 0xb9dc9ce 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.351 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.401 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b55f 0x10d76c 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:41.401 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.409 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4b12f 0x3b8c0f7 0x3b8c278 0xb9e9267 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xb9ec717 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.409 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.409 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4aba4 0x3ac7b0e 0x3b8c26d 0xb9effcb 0xb9f0280 0xb9d8651 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.409 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.492 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab7c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.492 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:41.492 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10d767 0xdd31a 0x4ab1c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:41.492 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:42.843 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:42.843 INFO:teuthology.orchestra.run.smithi110.stderr:Suppressions used: 2024-09-16T16:46:42.844 INFO:teuthology.orchestra.run.smithi110.stderr: count bytes template 2024-09-16T16:46:42.844 INFO:teuthology.orchestra.run.smithi110.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:42.844 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:42.844 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-16T16:46:42.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T16:46:42.894 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:43.169 INFO:teuthology.orchestra.run.smithi110.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:43.170 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:43,170 seastar - Reactor backend: linux-aio 2024-09-16T16:46:43.175 INFO:teuthology.orchestra.run.smithi110.stderr:==27641==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:43.282 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156e8 0xdd312 0x4b14c 0x6038c07 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:43.282 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:43.294 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:43,295 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T16:46:43.294 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:43,295 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T16:46:43.295 INFO:teuthology.orchestra.run.smithi110.stderr:DEBUG 2024-09-16 16:46:43,295 [shard 0:main] seastar - reactor::drain 2024-09-16T16:46:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:Suppressions used: 2024-09-16T16:46:43.800 INFO:teuthology.orchestra.run.smithi110.stderr: count bytes template 2024-09-16T16:46:43.800 INFO:teuthology.orchestra.run.smithi110.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:43.800 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:43.800 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-16T16:46:43.852 INFO:teuthology.orchestra.run.smithi110.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T16:46:43.856 INFO:teuthology.orchestra.run.smithi110.stderr:INFO 2024-09-16 16:46:43,857 seastar - Reactor backend: linux-aio 2024-09-16T16:46:43.873 INFO:teuthology.orchestra.run.smithi110.stderr:==27639==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T16:46:43.938 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5fd28b4 0x5fb964c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:43.938 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.100 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb9c787d 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96a9bec 0x96a9f88 0x96aa10d 0x96aa1af 0x96aa2c8 0xbe45609 0xbe45810 0xbe458e6 0xbe45a21 0xbe45e15 0xbe451d8 0xbe452b8 0xbe453cc 0xbe4508f 0x9507f90 0x95ecfd2 0x9324493 0x932466d 0x93247a8 0x9324862 0x932493c 0x9324e88 0x9325160 0x9325215 0x959c95c 0x959cbc1 0x95cadf8 0x96ce5a6 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:44.100 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.151 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x12525c 0x10a2b9 0xfca1b 0x386a219 0xb9ce176 0x9843791 0x9af9974 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.151 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xdd332 0x4ab1c 0x3ac7b0e 0x3b8c26d 0xb9e909a 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xb9ec717 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x932dfed 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.151 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.151 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x9046f 0x37669fb 0x3766be5 0xb9e4bd9 0xb9c6951 0xb9db22b 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:44.184 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4b1c5 0xb9c9df5 0xb9cefb9 0x9e042d9 0x9e0ddce 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4b14c 0x5c1431a 0x5c14565 0x5c421e3 0xb854f38 0xba25db6 0xb9caf71 0x9e0e315 0x9e2237e 0x99fffb1 0x9a005b7 0x98f54f0 0x932e1f1 0x932ef8c 0x932f00f 0x932f094 0x932f196 0x932f28e 0x932f314 0x932f3cd 0x932f583 0x932f6bb 0x932f736 0x932f7bb 0x932f916 0x932fa30 0x932fab5 0x932fb93 0x9552886 0x961b5f3 0x961b770 0x96dc4d1 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.242 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb9fdb9b 0xba39123 0xba394ae 0xb9d98a8 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:44.242 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.277 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156cf 0xdd312 0x4ab1c 0x3ac7b0e 0x3b8c26d 0xb9e9267 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xb9ec717 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.277 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x162bd4 0x422c4 0x3ef7b 0xfd531 0xba22320 0xba30fbe 0xba310f0 0xba3126c 0xba31a18 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.277 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.277 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.328 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ab7c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T16:46:44.328 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.335 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x3b8bfec 0x3b8c278 0xb9e909a 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xb9ec717 0xb9ecb62 0xb9d8a8c 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.335 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.335 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0xb9e8f96 0xb9ea53a 0xb9ea7b4 0xb9ea95c 0xba31cb1 0xb9d8ccf 0xb9dc6f8 0xb9c7696 0xb9c7a7a 0x9afa023 0x9b11b72 0x99a2168 0x9942951 0x927469d 0x9274db2 0x92752ce 0x9275457 0x927569e 0x9275976 0x9275a2b 0x9592ce8 0x9592f4d 0x95caf33 0x96cf51e 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.335 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.418 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x5542300 0x9e3396e 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.418 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:44.418 INFO:teuthology.orchestra.run.smithi110.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x4ac0c 0x5542dfb 0x9e33940 0x9ea2e39 0x9ed3631 0x9e3abc4 0x9959157 0x9878562 0x989cc22 0x989cd81 0x98ae61e 0x98ae7ee 0x98aeafc 0x98aee0b 0x98aef6a 0x98aefe5 0x98af22c 0x98af4f0 0x98af580 0x98af624 0x95c34b2 0x95c3717 0x95cbcbc 0x96be366 0xbb95287 0xbbad105 0xbc5a9af 0xbc6cfab 0xbc6d62d 0x7b30c45 0xc602d44 0x5e669 0x89c51 0x10ec7f 2024-09-16T16:46:44.418 INFO:teuthology.orchestra.run.smithi110.stderr:kernel callstack: 2024-09-16T16:46:45.769 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:45.769 INFO:teuthology.orchestra.run.smithi110.stderr:Suppressions used: 2024-09-16T16:46:45.769 INFO:teuthology.orchestra.run.smithi110.stderr: count bytes template 2024-09-16T16:46:45.769 INFO:teuthology.orchestra.run.smithi110.stderr: 1 8 MallocExtension::Register 2024-09-16T16:46:45.769 INFO:teuthology.orchestra.run.smithi110.stderr:----------------------------------------------------- 2024-09-16T16:46:45.769 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-16T16:46:45.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T16:46:45.819 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T16:46:45.819 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:45.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T16:46:45.850 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:45.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T16:46:45.921 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:45.921 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T16:46:45.945 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:45.945 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T16:46:46.010 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:46.010 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T16:46:46.075 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:46.076 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T16:46:46.095 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:46.095 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T16:46:46.131 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T16:46:46.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDqYOhmJ+vYFRAA3bvT/BfoF2Mnv8aD4kMo4g== 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDtYOhm1yj7GBAAHxtG6b0unTBbdlDlnFi1dA== 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDoYOhmnq2fGRAAPSifRpRzrALveRB/poEYYw== 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-09-16T16:46:46.164 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDxYOhmEnBxBRAA23auPTVERyNY0JyqtI2jhw== 2024-09-16T16:46:46.165 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-09-16T16:46:46.165 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQD0YOhmrNv6ABAAhq6OtN4IWbOiOL43dBT++A== 2024-09-16T16:46:46.165 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-16T16:46:46.165 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDoYOhmpgnjHBAAkbDANUBNrAftG5o5IhGIcg== 2024-09-16T16:46:46.165 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2024-09-16T16:46:46.165 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQDoYOhmPB65IBAAaA75ZM9K4xRakooADhLoFw== 2024-09-16T16:46:46.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:46.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:46.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T16:46:46.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:46.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T16:46:46.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:46.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T16:46:46.664 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T16:46:46.664 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:46.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T16:46:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:46.803+0000 7ff140a2dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:46.803+0000 7ff140a2dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:46.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T16:46:46.843 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T16:46:46.899 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T16:46:46.900 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T16:46:46.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T16:46:46.942 INFO:tasks.ceph.mon.a:Started 2024-09-16T16:46:46.943 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T16:46:46.943 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T16:46:46.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T16:46:46.945 INFO:tasks.ceph.mgr.x:Started 2024-09-16T16:46:46.945 DEBUG:tasks.ceph:set 0 configs 2024-09-16T16:46:46.946 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T16:46:46.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T16:46:47.026 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-09-16T16:46:47.024+0000 7f7590eeac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.026 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-09-16T16:46:47.024+0000 7f7590eeac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.026 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-09-16T16:46:47.024+0000 7f7590eeac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:47.050+0000 7fbd93e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:47.062+0000 7fbd93e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-16T16:46:47.149 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T16:46:47.149 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T16:46:47.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T16:46:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:47.252+0000 7f7af2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:47.262+0000 7f7af2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.341 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-16T16:46:47.340+0000 7f7086dcf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.346 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-09-16T16:46:47.345+0000 7f7587bf4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T16:46:47.346 INFO:tasks.ceph.mon.a.smithi002.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T16:46:47.346 INFO:tasks.ceph.mon.a.smithi002.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T16:46:47.346 INFO:tasks.ceph.mon.a.smithi002.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T16:46:47.346 INFO:tasks.ceph.mon.a.smithi002.stderr:feature with important data. 2024-09-16T16:46:47.346 INFO:tasks.ceph.mon.a.smithi002.stderr: 2024-09-16T16:46:47.347 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-16T16:46:47.345+0000 7f7086dcf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:47.347 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-16T16:46:47.345+0000 7f7086dcf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:48.154 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T16:46:48.155 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:48.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T16:46:48.185 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-16T16:46:48.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T16:46:48.254 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:48.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T16:46:48.279 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-16T16:46:48.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T16:46:48.344 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new e22e91d1-01fb-42aa-a17f-81c0cddb4ea6 0 2024-09-16T16:46:48.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:48.484+0000 7f1600951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:48.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:48.493+0000 7f1600951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:48.570 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-09-16T16:46:48.582 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new ff18a013-2e71-4d79-b38c-4a24893a1238 1 2024-09-16T16:46:48.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:48.681+0000 7f3c86f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:48.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:48.691+0000 7f3c86f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:48.769 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-09-16T16:46:48.780 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 44c5c2b9-81de-44d6-99d1-260e3d24c59c 2 2024-09-16T16:46:48.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:48.881+0000 7f52d5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:48.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:48.890+0000 7f52d5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:48.967 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-09-16T16:46:48.979 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 95738d6c-1956-4c40-a479-f8d46df7d0d1 3 2024-09-16T16:46:49.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:49.078+0000 7f1bb8ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:49.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-16T16:46:49.088+0000 7f1bb8ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:49.165 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-09-16T16:46:49.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:49.214 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T16:46:49.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T16:46:49.257 INFO:tasks.ceph.osd.0:Started 2024-09-16T16:46:49.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:49.292 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T16:46:49.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T16:46:49.334 INFO:tasks.ceph.osd.1:Started 2024-09-16T16:46:49.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:49.365 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T16:46:49.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T16:46:49.408 INFO:tasks.ceph.osd.2:Started 2024-09-16T16:46:49.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:49.437 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T16:46:49.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T16:46:49.479 INFO:tasks.ceph.osd.3:Started 2024-09-16T16:46:49.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:49.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:49.593+0000 7f10e9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:49.602+0000 7f10e9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:49.674 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:46:49.674 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T16:46:49.164959+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:49.685 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T16:46:49.686 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T16:46:50.089 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:50.197 INFO:teuthology.misc.health.smithi002.stderr:2024-09-16T16:46:50.192+0000 7f55f844f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:50.202 INFO:teuthology.misc.health.smithi002.stderr:2024-09-16T16:46:50.201+0000 7f55f844f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:50.272 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-16T16:46:50.272 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":7,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T16:46:49.164959+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:50.283 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T16:46:53.369 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-16T16:46:53.368+0000 7f7024104640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T16:46:56.686 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T16:46:56.792 INFO:teuthology.misc.health.smithi002.stderr:2024-09-16T16:46:56.787+0000 7f5f2e893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:56.797 INFO:teuthology.misc.health.smithi002.stderr:2024-09-16T16:46:56.797+0000 7f5f2e893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:56.998 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-16T16:46:56.998 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":12,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T16:46:56.158630+0000","last_up_change":"2024-09-16T16:46:54.148710+0000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:54.401070+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1494647852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1494647852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1494647852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":1494647852}]},"public_addr":"172.21.15.2:6800/1494647852","cluster_addr":"172.21.15.2:6801/1494647852","heartbeat_back_addr":"172.21.15.2:6806/1494647852","heartbeat_front_addr":"172.21.15.2:6807/1494647852","state":["exists","up"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":983989567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":983989567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":983989567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6817","nonce":983989567}]},"public_addr":"172.21.15.2:6802/983989567","cluster_addr":"172.21.15.2:6803/983989567","heartbeat_back_addr":"172.21.15.2:6816/983989567","heartbeat_front_addr":"172.21.15.2:6817/983989567","state":["exists","up"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1898686600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":1898686600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1898686600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6813","nonce":1898686600}]},"public_addr":"172.21.15.110:6806/1898686600","cluster_addr":"172.21.15.110:6807/1898686600","heartbeat_back_addr":"172.21.15.110:6812/1898686600","heartbeat_front_addr":"172.21.15.110:6813/1898686600","state":["exists","up"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2099580700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":2099580700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2099580700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6809","nonce":2099580700}]},"public_addr":"172.21.15.110:6804/2099580700","cluster_addr":"172.21.15.110:6803/2099580700","heartbeat_back_addr":"172.21.15.110:6810/2099580700","heartbeat_front_addr":"172.21.15.110:6809/2099580700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:46:57.011 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T16:46:57.011 INFO:tasks.ceph:Creating RBD pool 2024-09-16T16:46:57.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T16:46:57.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:57.118+0000 7f1b27151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:57.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:57.132+0000 7f1b27151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:58.173 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'rbd' created 2024-09-16T16:46:58.193 DEBUG:teuthology.orchestra.run.smithi002:> rbd --cluster ceph pool init rbd 2024-09-16T16:46:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:58.300+0000 7f745f259ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:58.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:58.300+0000 7f745f259ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:46:58.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:46:58.306+0000 7f745f259ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.246 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T16:47:01.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T16:47:01.247 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T16:47:01.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:01.357+0000 7f7706aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:01.367+0000 7f7706aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:01.579 INFO:teuthology.orchestra.run.smithi002.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T16:47:01.580 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T16:47:01.580 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T16:47:01.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T16:47:01.580 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T16:47:01.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:01.688+0000 7fab314bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:01.696+0000 7fab314bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:01.943 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:01.955 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":4057091642},{"type":"v1","addr":"172.21.15.110:6801","nonce":4057091642}]},"active_addr":"172.21.15.110:6801/4057091642","active_change":"2024-09-16T16:46:52.358290+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1444875325}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2447475019}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3283450110}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1126028115}]}]} 2024-09-16T16:47:01.957 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T16:47:01.958 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T16:47:01.958 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:47:02.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.066+0000 7feb52ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.074+0000 7feb52ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:02.275 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T16:47:01.185051+0000","last_up_change":"2024-09-16T16:46:54.148710+0000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:54.401070+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:57.342737+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1494647852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1494647852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1494647852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":1494647852}]},"public_addr":"172.21.15.2:6800/1494647852","cluster_addr":"172.21.15.2:6801/1494647852","heartbeat_back_addr":"172.21.15.2:6806/1494647852","heartbeat_front_addr":"172.21.15.2:6807/1494647852","state":["exists","up"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":983989567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":983989567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":983989567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6817","nonce":983989567}]},"public_addr":"172.21.15.2:6802/983989567","cluster_addr":"172.21.15.2:6803/983989567","heartbeat_back_addr":"172.21.15.2:6816/983989567","heartbeat_front_addr":"172.21.15.2:6817/983989567","state":["exists","up"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1898686600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":1898686600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1898686600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6813","nonce":1898686600}]},"public_addr":"172.21.15.110:6806/1898686600","cluster_addr":"172.21.15.110:6807/1898686600","heartbeat_back_addr":"172.21.15.110:6812/1898686600","heartbeat_front_addr":"172.21.15.110:6813/1898686600","state":["exists","up"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2099580700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":2099580700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2099580700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6809","nonce":2099580700}]},"public_addr":"172.21.15.110:6804/2099580700","cluster_addr":"172.21.15.110:6803/2099580700","heartbeat_back_addr":"172.21.15.110:6810/2099580700","heartbeat_front_addr":"172.21.15.110:6809/2099580700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:47:02.288 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T16:47:02.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T16:47:02.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.396+0000 7f4cfe591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.404+0000 7f4cfe591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:02.605 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T16:47:01.185051+0000","last_up_change":"2024-09-16T16:46:54.148710+0000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:54.401070+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:57.342737+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1494647852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1494647852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1494647852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":1494647852}]},"public_addr":"172.21.15.2:6800/1494647852","cluster_addr":"172.21.15.2:6801/1494647852","heartbeat_back_addr":"172.21.15.2:6806/1494647852","heartbeat_front_addr":"172.21.15.2:6807/1494647852","state":["exists","up"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":983989567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":983989567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":983989567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6817","nonce":983989567}]},"public_addr":"172.21.15.2:6802/983989567","cluster_addr":"172.21.15.2:6803/983989567","heartbeat_back_addr":"172.21.15.2:6816/983989567","heartbeat_front_addr":"172.21.15.2:6817/983989567","state":["exists","up"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1898686600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":1898686600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1898686600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6813","nonce":1898686600}]},"public_addr":"172.21.15.110:6806/1898686600","cluster_addr":"172.21.15.110:6807/1898686600","heartbeat_back_addr":"172.21.15.110:6812/1898686600","heartbeat_front_addr":"172.21.15.110:6813/1898686600","state":["exists","up"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2099580700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":2099580700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2099580700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6809","nonce":2099580700}]},"public_addr":"172.21.15.110:6804/2099580700","cluster_addr":"172.21.15.110:6803/2099580700","heartbeat_back_addr":"172.21.15.110:6810/2099580700","heartbeat_front_addr":"172.21.15.110:6809/2099580700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T16:47:02.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T16:47:02.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T16:47:02.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T16:47:02.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T16:47:02.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.740+0000 7ff7a26bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.740+0000 7fde89d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.740+0000 7f71f4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.740+0000 7f1ecc26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.751+0000 7ff7a26bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.751+0000 7fde89d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.751+0000 7f1ecc26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.751+0000 7f71f4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.788 INFO:teuthology.orchestra.run.smithi002.stdout:38654705673 2024-09-16T16:47:02.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T16:47:02.789 INFO:teuthology.orchestra.run.smithi002.stdout:42949672968 2024-09-16T16:47:02.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T16:47:02.792 INFO:teuthology.orchestra.run.smithi002.stdout:42949672968 2024-09-16T16:47:02.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T16:47:02.793 INFO:teuthology.orchestra.run.smithi002.stdout:42949672968 2024-09-16T16:47:02.793 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T16:47:02.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.902+0000 7f2bf3991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.916+0000 7f2bf3991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.949+0000 7f5e9ecbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.949+0000 7fc618391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.949+0000 7fe37546c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.960+0000 7fe37546c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.960+0000 7fc618391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:02.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:02.961+0000 7f5e9ecbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:03.131 INFO:teuthology.orchestra.run.smithi002.stdout:38654705673 2024-09-16T16:47:03.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2024-09-16T16:47:03.145 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:03.179 INFO:teuthology.orchestra.run.smithi002.stdout:42949672968 2024-09-16T16:47:03.181 INFO:teuthology.orchestra.run.smithi002.stdout:42949672968 2024-09-16T16:47:03.189 INFO:teuthology.orchestra.run.smithi002.stdout:42949672968 2024-09-16T16:47:03.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.3 2024-09-16T16:47:03.195 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:03.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2024-09-16T16:47:03.198 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:03.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.2 2024-09-16T16:47:03.204 DEBUG:teuthology.parallel:result is None 2024-09-16T16:47:03.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:47:03.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:03.352+0000 7fa83c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:03.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:03.361+0000 7fa83c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:03.558 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:03.571 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T16:47:02.778255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:03.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:03.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:03.680+0000 7f3408911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:03.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:03.688+0000 7f3408911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:03.882 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:03.882 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:03.895 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T16:47:02.778255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:03.895 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:47:03.895 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T16:47:03.896 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T16:47:03.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T16:47:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:04.003+0000 7efe03111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:04.011+0000 7efe03111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.247 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:04.248 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T16:47:04.261 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T16:47:04.261 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-16T16:47:04.274 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T16:47:04.274 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}} 2024-09-16T16:47:04.274 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T16:47:04.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-16T16:47:04.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:04.382+0000 7f55ff791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:04.395+0000 7f55ff791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.611 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-16T16:47:04.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T16:47:04.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:04.720+0000 7f369b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:04.729+0000 7f369b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:04.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:04.924 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:04.936 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-16T16:47:04.365892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.587636"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:04.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:05.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:05.046+0000 7f0c12f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:05.055+0000 7f0c12f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:05.254 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:05.266 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-16T16:47:04.365892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.587636"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:05.267 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T16:47:05.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-16T16:47:05.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:05.375+0000 7f9b49191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:05.384+0000 7f9b49191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 17 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:fsid c4016161-76cd-4174-ba7b-1295c2a4f0b9 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-16T16:46:47.048657+0000 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-16T16:47:01.185051+0000 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 4 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-09-16T16:47:05.583 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client jewel 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:allow_crimson=true 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 13 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout: removed_snaps_queue [2~1] 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 4 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 9 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.2:6800/1494647852 v2:172.21.15.2:6801/1494647852 exists,up e22e91d1-01fb-42aa-a17f-81c0cddb4ea6 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.2:6802/983989567 v2:172.21.15.2:6803/983989567 exists,up ff18a013-2e71-4d79-b38c-4a24893a1238 2024-09-16T16:47:05.584 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.110:6806/1898686600 v2:172.21.15.110:6807/1898686600 exists,up 44c5c2b9-81de-44d6-99d1-260e3d24c59c 2024-09-16T16:47:05.585 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.110:6804/2099580700 v2:172.21.15.110:6803/2099580700 exists,up 95738d6c-1956-4c40-a479-f8d46df7d0d1 2024-09-16T16:47:05.596 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.2:6800/1494647852 v2:172.21.15.2:6801/1494647852 exists,up e22e91d1-01fb-42aa-a17f-81c0cddb4ea6', 'osd.1 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.2:6802/983989567 v2:172.21.15.2:6803/983989567 exists,up ff18a013-2e71-4d79-b38c-4a24893a1238', 'osd.2 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.110:6806/1898686600 v2:172.21.15.110:6807/1898686600 exists,up 44c5c2b9-81de-44d6-99d1-260e3d24c59c', 'osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:172.21.15.110:6804/2099580700 v2:172.21.15.110:6803/2099580700 exists,up 95738d6c-1956-4c40-a479-f8d46df7d0d1'] 2024-09-16T16:47:05.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mon.a", 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster": "ceph", 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout: "admin_socket_mode": "", 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_client_required": "cephx, none", 2024-09-16T16:47:05.706 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_cluster_required": "cephx", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_debug": "true", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_service_required": "cephx", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_supported": "cephx", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_aio": "true", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_aio_poll_ms": "250", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_aio_reap_max": "16", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_async_discard_threads": "0", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_block_size": "4096", 2024-09-16T16:47:05.707 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_debug_aio": "false", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_debug_inflight_ios": "false", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_enable_discard": "false", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_flock_retry": "3", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_inject_crash": "0", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_ioring": "false", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_ioring_hipri": "false", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-16T16:47:05.708 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bdev_type": "", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_alloc_size": "1048576", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_allocator": "hybrid", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_buffered_io": "true", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_check_for_zeros": "false", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_compact_log_sync": "false", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-16T16:47:05.709 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_max_log_runway": "4194304", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_max_prefetch": "1048576", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_min_flush_size": "524288", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_min_log_runway": "1048576", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_replay_recovery": "false", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_sync_write": "false", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-16T16:47:05.710 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_allocation_from_file": "true", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_allocator": "hybrid", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_async_db_compaction": "true", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bdev_label_multi": "true", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-16T16:47:05.711 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_create": "true", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_db_create": "false", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_db_path": "", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_db_size": "0", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_path": "", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_preallocate_file": "false", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_size": "107374182400", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_wal_create": "false", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_wal_path": "", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_block_wal_size": "100663296", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bluefs": "true", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-16T16:47:05.712 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_autotune": "true", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_size": "0", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-16T16:47:05.713 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_type": "2q", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_clone_cow": "true", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_mode": "none", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-16T16:47:05.714 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_csum_type": "crc32c", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_freelist": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-16T16:47:05.715 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_small_allocations": "0", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_default_buffered_read": "true", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_default_buffered_write": "false", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fail_eio": "false", 2024-09-16T16:47:05.716 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_on_mount": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_on_umount": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-16T16:47:05.717 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_ignore_data_csum": "false", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_log_op_age": "5.000000", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_max_alloc_size": "0", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_max_blob_size": "0", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-16T16:47:05.718 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_max_deferred_txc": "32", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_min_alloc_size": "0", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_nid_prealloc": "1024", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_retry_disk_reads": "3", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_rocksdb_cf": "true", 2024-09-16T16:47:05.719 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_spdk_mem": "512", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-16T16:47:05.720 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_tracing": "false", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-16T16:47:05.721 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_write_v2": "false", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_write_v2_random": "false", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_zero_block_detection": "false", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-16T16:47:05.722 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephx_cluster_require_signatures": "false", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephx_cluster_require_version": "2", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephx_require_signatures": "false", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephx_require_version": "2", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephx_service_require_signatures": "false", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephx_service_require_version": "2", 2024-09-16T16:47:05.723 INFO:teuthology.orchestra.run.smithi002.stdout: "cephx_sign_messages": "true", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "chdir": "", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_acl_type": "", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_asio_thread_count": "2", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_cache_mid": "0.750000", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_cache_size": "16384", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_caps_release_delay": "5", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_check_pool_perm": "true", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_debug_force_sync_read": "false", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_debug_getattr_caps": "false", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_debug_inject_features": "", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_debug_inject_tick_delay": "0", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-16T16:47:05.724 INFO:teuthology.orchestra.run.smithi002.stdout: "client_die_on_failed_remount": "false", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_dirsize_rbytes": "true", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_force_lazyio": "false", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_fs": "", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_inject_release_failure": "false", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_max_inline_size": "4096", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_mds_namespace": "", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_metadata": "", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_mount_gid": "-1", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_mount_timeout": "300", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_mount_uid": "-1", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_mountpoint": "/", 2024-09-16T16:47:05.725 INFO:teuthology.orchestra.run.smithi002.stdout: "client_notify_timeout": "10", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_oc": "true", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_oc_max_dirty": "104857600", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_oc_max_objects": "1000", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_oc_size": "209715200", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_oc_target_dirty": "8388608", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_permissions": "true", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_quota": "true", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_quota_df": "true", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_readahead_max_bytes": "0", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_readahead_max_periods": "4", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_readahead_min": "131072", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_reconnect_stale": "false", 2024-09-16T16:47:05.726 INFO:teuthology.orchestra.run.smithi002.stdout: "client_shutdown_timeout": "30", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "client_snapdir": ".snap", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "client_tick_interval": "1", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "client_trace": "", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "client_try_dentry_invalidate": "false", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "client_use_faked_inos": "false", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "client_use_random_mds": "false", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "clog_to_graylog": "false", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "clog_to_graylog_port": "12201", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "clog_to_monitors": "default=true", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "clog_to_syslog": "false", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "clog_to_syslog_level": "info", 2024-09-16T16:47:05.727 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_addr": "-", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_network": "", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_network_interface": "", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "compressor_zlib_isal": "false", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "compressor_zlib_level": "5", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "compressor_zlib_winsize": "-15", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "compressor_zstd_level": "1", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "crimson_alien_op_num_threads": "6", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "crimson_osd_stat_interval": "0", 2024-09-16T16:47:05.728 INFO:teuthology.orchestra.run.smithi002.stdout: "crimson_seastar_cpu_cores": "", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "crimson_seastar_num_threads": "0", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_location": "", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_location_hook": "", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_location_hook_timeout": "10", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "daemonize": "false", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "daos_pool": "tank", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_alienstore": "0/5", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_allow_any_pool_priority": "false", 2024-09-16T16:47:05.729 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_asok": "1/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_asok_assert_abort": "false", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_asserts_on_shutdown": "true", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_auth": "20/20", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_bdev": "1/3", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_bluefs": "1/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_bluestore": "1/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_buffer": "0/1", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_ceph_dedup": "0/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_ceph_exporter": "1/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_cephfs_mirror": "0/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_cephsqlite": "0/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_client": "0/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_compressor": "1/5", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_context": "0/1", 2024-09-16T16:47:05.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_crimson_interrupt": "0/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_crush": "1/1", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_crypto": "1/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_cyanstore": "0/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_deliberately_leak_memory": "false", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_disable_randomized_ping": "false", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_dpdk": "1/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_eventtrace": "1/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_filer": "0/1", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_filestore": "1/3", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_finisher": "1/1", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_fuse": "1/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_heartbeat_testing_span": "0", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_heartbeatmap": "1/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-16T16:47:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_javaclient": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_journal": "1/3", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_journaler": "0/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_kstore": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_lockdep": "0/1", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mclock": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mds": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mds_balancer": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mds_locker": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mds_log": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mds_log_expire": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mds_migrator": "1/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mds_quiesce": "3/5", 2024-09-16T16:47:05.732 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_memstore": "1/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mgr": "2/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mgrc": "1/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_mon": "20/20", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_monc": "0/10", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_ms": "1/1", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_none": "0/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_objclass": "0/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_objectcacher": "0/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_objecter": "0/1", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_optracker": "0/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_osd": "1/5", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_paxos": "20/20", 2024-09-16T16:47:05.733 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_perfcounter": "1/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_prioritycache": "1/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rados": "0/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rbd": "0/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rbd_mirror": "0/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rbd_pwl": "0/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rbd_replay": "0/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_refs": "0/0", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_reserver": "1/1", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw": "1/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw_access": "1/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw_datacache": "1/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw_dbstore": "1/5", 2024-09-16T16:47:05.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw_flight": "1/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw_notification": "1/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rgw_sync": "1/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_rocksdb": "4/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_backref": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_cache": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_cleaner": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_device": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_epm": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_journal": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_lba": "0/5", 2024-09-16T16:47:05.735 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_odata": "0/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_omap": "0/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_onode": "0/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_t": "0/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_seastore_tm": "0/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_striper": "0/1", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_test": "0/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_throttle": "1/1", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_timer": "0/1", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_tp": "0/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug_trace": "1/5", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "device_failure_prediction_mode": "none", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-16T16:47:05.736 INFO:teuthology.orchestra.run.smithi002.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "err_to_graylog": "false", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "err_to_journald": "false", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "err_to_stderr": "true", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "err_to_syslog": "false", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "event_tracing": "false", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_addr": "0.0.0.0", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_cert_file": "", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_http_port": "9926", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_key_file": "", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_prio_limit": "5", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_sort_metrics": "true", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "exporter_stats_period": "5", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "fake_statfs_for_testing": "0", 2024-09-16T16:47:05.737 INFO:teuthology.orchestra.run.smithi002.stdout: "fatal_signal_handlers": "true", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filer_max_purge_ops": "10", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filer_max_truncate_ops": "128", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_apply_finisher_threads": "1", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_blackhole": "false", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_btrfs_clone_range": "true", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_btrfs_snap": "true", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_caller_concurrency": "10", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_collect_device_partition_information": "true", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_commit_timeout": "600.000000", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_debug_inject_read_err": "false", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_debug_omap_check": "false", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_debug_verify_split": "false", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_dump_file": "", 2024-09-16T16:47:05.738 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_fadvise": "true", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_fail_eio": "true", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_fd_cache_shards": "16", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_fd_cache_size": "128", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_fiemap": "false", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_fiemap_threshold": "4096", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_inject_stall": "0", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_journal_parallel": "false", 2024-09-16T16:47:05.739 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_journal_trailing": "false", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_journal_writeahead": "false", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_kill_at": "0", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattrs": "0", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-16T16:47:05.740 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_xattr_value_size": "0", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_merge_threshold": "-10", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_odsync_write": "false", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_omap_backend": "rocksdb", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_omap_backend_path": "", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_op_thread_timeout": "60", 2024-09-16T16:47:05.741 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_op_threads": "2", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_punch_hole": "false", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_queue_max_ops": "50", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_seek_data_hole": "false", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_sloppy_crc": "false", 2024-09-16T16:47:05.742 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_splice": "false", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_split_multiple": "2", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_split_rand_factor": "20", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_update_to": "1000", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_enable": "true", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-16T16:47:05.743 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_xfs_extsize": "false", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "filestore_zfs_snap": "false", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "fio_dir": "/tmp/fio", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "fsid": "c4016161-76cd-4174-ba7b-1295c2a4f0b9", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_allow_other": "true", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_atomic_o_trunc": "true", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_big_writes": "true", 2024-09-16T16:47:05.744 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_debug": "false", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_default_permissions": "false", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_disable_pagecache": "false", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_max_write": "0", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_multithreaded": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_require_active_mds": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_set_user_groups": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_splice_move": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_splice_read": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_splice_write": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "fuse_use_invalidate_cb": "true", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-16T16:47:05.745 INFO:teuthology.orchestra.run.smithi002.stdout: "gss_target_name": "ceph", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_file": "", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_inject_failure": "0", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "heartbeat_interval": "5", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "host": "smithi002", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-16T16:47:05.746 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "inject_early_sigterm": "false", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "jaeger_agent_port": "6799", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "jaeger_tracing_enable": "false", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_aio": "true", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_align_min_size": "65536", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_block_align": "true", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_block_size": "4096", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_dio": "true", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_discard": "false", 2024-09-16T16:47:05.747 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_force_aio": "false", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_ignore_corruption": "false", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_max_write_bytes": "10485760", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_max_write_entries": "100", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_replay_from": "0", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_write_header_frequency": "0", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journal_zero_on_create": "false", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journaler_prefetch_periods": "10", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journaler_prezero_periods": "5", 2024-09-16T16:47:05.748 INFO:teuthology.orchestra.run.smithi002.stdout: "journaler_write_head_interval": "15", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "keyfile": "", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_backend": "rocksdb", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_default_stripe_size": "65536", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_fsck_on_mount": "false", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_max_bytes": "67108864", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_max_ops": "512", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_nid_prealloc": "1024", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_onode_map_size": "1024", 2024-09-16T16:47:05.749 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_sync_submit_transaction": "false", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "kstore_sync_transaction": "false", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "librados_thread_count": "2", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "lockdep": "false", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "lockdep_force_backtrace": "false", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_coarse_timestamps": "true", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_flush_on_exit": "false", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_graylog_host": "127.0.0.1", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_graylog_port": "12201", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_max_new": "1000", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_max_recent": "10000", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_stderr_prefix": "", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_stop_at_utilization": "0.970000", 2024-09-16T16:47:05.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": "true", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_graylog": "false", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_journald": "false", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_stderr": "false", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_syslog": "false", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max_rotating_auth_attempts": "10", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_action_on_write_error": "1", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_alternate_name_max": "8192", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_asio_thread_count": "2", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_export_pin": "true", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_fragment_dirs": "true", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_fragment_interval": "5", 2024-09-16T16:47:05.751 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_interval": "10", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_max": "-1", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_max_until": "-1", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_merge_size": "50", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_midchunk": "0.300000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_min_start": "0.200000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_minchunk": "0.001000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_mode": "0", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_need_max": "1.200000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_need_min": "0.800000", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_overload_epochs": "2", 2024-09-16T16:47:05.752 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_split_bits": "3", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_split_size": "10000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_target_decay": "10.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_beacon_grace": "15.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_beacon_interval": "4.000000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_mid": "0.700000", 2024-09-16T16:47:05.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_quiesce_delay": "0", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_release_free_interval": "10", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_reservation": "0.050000", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_trim_interval": "1", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache_trim_threshold": "262144", 2024-09-16T16:47:05.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_client_prealloc_inos": "1000", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_connect_bootstrapping": "false", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_damage_table_max_entries": "10000", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-16T16:47:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_debug_auth_pins": "false", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_debug_frag": "false", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_debug_scatterstat": "false", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_debug_subtrees": "false", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_decay_halflife": "5.000000", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_default_dir_hash": "2", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_defer_session_stale": "true", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_deny_all_reconnect": "false", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dir_keys_per_op": "16384", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dir_max_commit_size": "10", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dir_max_entries": "0", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dir_prefetch": "true", 2024-09-16T16:47:05.756 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dump_cache_on_map": "false", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_early_reply": "true", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_enable_op_tracker": "true", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_enforce_unique_name": "true", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_export_ephemeral_random": "true", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-16T16:47:05.757 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_health_summarize_threshold": "10", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_inject_health_dummy": "false", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-16T16:47:05.758 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_inject_migrator_session_race": "false", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_join_fs": "", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_journal_format": "1", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_create_at": "0", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_dirfrag_at": "0", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_export_at": "0", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_import_at": "0", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_journal_at": "0", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_journal_expire_at": "0", 2024-09-16T16:47:05.759 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_journal_replay_at": "0", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_link_at": "0", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_mdstable_at": "0", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_openc_at": "0", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_rename_at": "0", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_kill_shutdown_at": "0", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_event_large_threshold": "524288", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_events_per_segment": "1024", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_max_events": "-1", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_max_segments": "128", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_pause": "false", 2024-09-16T16:47:05.760 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_segment_size": "0", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_trim_threshold": "128", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log_warn_factor": "2.000000", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_caps_per_client": "1048576", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_completed_flushes": "100000", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_completed_requests": "100000", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_export_size": "20971520", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_file_recover": "32", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_purge_files": "64", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_purge_ops": "8192", 2024-09-16T16:47:05.761 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_max_snaps_per_dir": "100", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_metrics_update_interval": "2", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_min_caps_per_client": "100", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_min_caps_working_set": "10000", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_numa_node": "-1", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_op_complaint_time": "30.000000", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_op_history_duration": "600", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_op_history_size": "20", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_op_history_slow_op_size": "20", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-16T16:47:05.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_op_log_threshold": "5", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_ping_grace": "15", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_ping_interval": "5", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_recall_max_caps": "30000", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_recall_warning_threshold": "262144", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_replay_interval": "1.000000", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_root_ino_gid": "0", 2024-09-16T16:47:05.763 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_root_ino_uid": "0", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_scrub_stats_review_period": "1", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-16T16:47:05.764 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_shutdown_check": "0", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_skip_ino": "0", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_snap_max_uid": "4294967294", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_snap_min_uid": "0", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_snap_rstat": "false", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_standby_replay_damaged": "false", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_symlink_recovery": "true", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_thrash_exports": "0", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_thrash_fragments": "0", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_tick_interval": "5.000000", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_valgrind_exit": "false", 2024-09-16T16:47:05.765 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_verify_backtrace": "1", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_verify_scatter": "false", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_wipe_sessions": "false", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool_debug": "false", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "memstore_device_bytes": "1073741824", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "memstore_page_set": "false", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "memstore_page_size": "65536", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_client_bytes": "134217728", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_client_messages": "512", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-16T16:47:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_disabled_modules": "", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_enable_op_tracker": "true", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_max_pg_creating": "1024", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_max_pg_num_change": "128", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_mds_bytes": "134217728", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_mds_messages": "128", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_mon_bytes": "134217728", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_mon_messages": "128", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_op_history_duration": "600", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_op_history_size": "20", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-16T16:47:05.767 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_op_log_threshold": "5", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_osd_bytes": "536870912", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_osd_messages": "8192", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_pool": "true", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_standby_modules": "true", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_stats_period": "5", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_stats_threshold": "5", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_tick_period": "2", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_allow_pool_delete": "true", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_allow_pool_size_one": "true", 2024-09-16T16:47:05.768 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_auth_validate_all_caps": "true", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_bytes": "104857600", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_directed_command_retry": "2", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_hunt_parallel": "3", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_log_interval": "1.000000", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-16T16:47:05.769 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_ping_interval": "10.000000", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_client_target_rank": "-1", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_level": "debug", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_file": "true", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-16T16:47:05.770 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_journald": "false", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_compact_on_bootstrap": "false", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_compact_on_start": "false", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_compact_on_trim": "true", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_cpu_threads": "4", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_crush_min_required_version": "hammer", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_daemon_bytes": "419430400", 2024-09-16T16:47:05.771 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_data_avail_crit": "5", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_data_avail_warn": "5", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_data_size_warn": "16106127360", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_dump_json": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_dump_transactions": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_extra_checks": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_no_require_reef": "false", 2024-09-16T16:47:05.772 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_no_require_squid": "false", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_down_mkfs_grace": "120", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_down_uptime_grace": "60", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_election_default_strategy": "1", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_election_timeout": "5.000000", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_elector_ping_divisor": "2", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_enable_op_tracker": "true", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_fake_pool_delete": "false", 2024-09-16T16:47:05.773 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_force_quorum_join": "false", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_globalid_prealloc": "10000", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_health_detail_to_clog": "false", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_health_log_update_period": "5", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_health_max_detail": "50", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_health_to_clog": "true", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_health_to_clog_interval": "600", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_host": "172.21.15.2", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_host_override": "", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_initial_members": "", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-16T16:47:05.774 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_lease": "5.000000", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_log_full_interval": "50", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_log_max": "10000", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_log_max_summary": "50", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_log_epochs": "500", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-16T16:47:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_osd": "10000", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_pg_per_osd": "10000", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_pool_pg_num": "65536", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mds_force_trim_to": "0", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mds_skip_sanity": "false", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_memory_autotune": "true", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_memory_target": "2147483648", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mgr_beacon_grace": "30", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mgr_digest_period": "5", 2024-09-16T16:47:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mgr_inactive_grace": "60", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_min_osdmap_epochs": "50", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_op_complaint_time": "30", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_op_history_duration": "600", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_op_history_size": "20", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_op_history_slow_op_size": "20", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_op_log_threshold": "5", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-16T16:47:05.777 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_auto_mark_in": "false", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_cache_size": "500", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_down_out_interval": "600", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-16T16:47:05.778 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_force_trim_to": "0", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_min_down_reporters": "2", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-16T16:47:05.779 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_report_timeout": "900", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pg_stuck_threshold": "60", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-16T16:47:05.780 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_probe_timeout": "2.000000", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_reweight_max_change": "0.050000", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_reweight_max_osds": "4", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-16T16:47:05.781 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_scrub_interval": "86400", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_scrub_max_keys": "100", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_scrub_timeout": "300", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_session_timeout": "300", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_smart_report_timeout": "5", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_stat_smooth_intervals": "6", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_stretch_pool_min_size": "2", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_stretch_pool_size": "4", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_sync_debug": "false", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-16T16:47:05.782 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_sync_provider_kill_at": "0", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_sync_requester_kill_at": "0", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_sync_timeout": "60.000000", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_target_pg_per_osd": "100", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_tick_interval": "5", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_timecheck_interval": "300.000000", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_use_min_delay_socket": "false", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_older_version_delay": "604800", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-16T16:47:05.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_misplaced": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_older_version": "true", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-16T16:47:05.784 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "monmap": "", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "motr_tracing_enabled": "false", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_op_threads": "3", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_cm": "false", 2024-09-16T16:47:05.785 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_device_name": "", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_dscp": "96", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_local_gid": "", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_port_num": "1", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_sl": "3", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_support_srq": "true", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_rdma_type": "ib", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_async_reap_threshold": "5", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_before_connect": "false", 2024-09-16T16:47:05.786 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_ipv4": "true", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_ipv6": "false", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_msgr1": "true", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_msgr2": "true", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_port_max": "7568", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_port_min": "6800", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_retry_count": "3", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_bind_retry_delay": "5", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_blackhole_client": "false", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_blackhole_mds": "false", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_blackhole_mgr": "false", 2024-09-16T16:47:05.787 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_blackhole_mon": "false", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_blackhole_osd": "false", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_client_mode": "crc", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_cluster_mode": "crc", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_cluster_type": "", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_compress_secure": "false", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_connection_idle_timeout": "900", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_connection_ready_timeout": "10", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_crc_data": "true", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_crc_header": "true", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_die_on_bad_msg": "false", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_die_on_bug": "true", 2024-09-16T16:47:05.788 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_die_on_old_message": "true", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_die_on_skipped_message": "false", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_coremask": "0xF", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_enable_tso": "true", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_hugepages": "", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_lro": "true", 2024-09-16T16:47:05.789 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_memory_channel": "4", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_pmd": "", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_port_id": "0", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_dump_on_send": "false", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_initial_backoff": "0.200000", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_inject_delay_max": "1.000000", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_inject_delay_type": "", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_inject_network_congestion": "0", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_inject_socket_failures": "0", 2024-09-16T16:47:05.790 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_learn_addr_from_peer": "true", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_max_accept_failures": "4", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_max_backoff": "15.000000", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_mon_client_mode": "crc", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_mon_cluster_mode": "crc", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_mon_service_mode": "crc", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_osd_compress_min_size": "1024", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_osd_compress_mode": "none", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_pq_min_cost": "65536", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_public_type": "", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_service_mode": "crc", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_tcp_listen_backlog": "512", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_tcp_nodelay": "true", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-16T16:47:05.791 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_tcp_rcvbuf": "0", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "ms_type": "async+posix", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "no_config_file": "false", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_completion_locks_per_session": "32", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_inflight_ops": "1024", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_tick_interval": "5.000000", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter_timeout": "10.000000", 2024-09-16T16:47:05.792 INFO:teuthology.orchestra.run.smithi002.stdout: "objectstore_blackhole": "false", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "openssl_engine_opts": "", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_agent_delay_time": "5.000000", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_agent_hist_halflife": "1000", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_agent_max_low_ops": "2", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_agent_max_ops": "4", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_agent_slop": "0.020000", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_asio_thread_count": "2", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_async_recovery_min_cost": "100", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-16T16:47:05.793 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_backfill_scan_max": "512", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_backfill_scan_min": "64", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_backoff_on_degraded": "false", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_backoff_on_peering": "false", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_backoff_on_unfound": "true", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_beacon_report_interval": "300", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bench_duration": "30", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bench_max_block_size": "67108864", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_blkin_trace_all": "false", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-16T16:47:05.794 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_check_for_log_corruption": "false", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_class_update_on_start": "true", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_client_message_cap": "256", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_client_message_size_cap": "524288000", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_client_op_priority": "63", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_client_watch_timeout": "30", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_command_max_records": "256", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_compact_on_start": "false", 2024-09-16T16:47:05.795 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_crush_update_on_start": "true", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_crush_update_weight_set": "true", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_feed_pullee": "-1", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-16T16:47:05.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_misdirected_ops": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_no_acting_change": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_no_purge_strays": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_op_order": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_shutdown": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_trim_objects": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-16T16:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_verify_snaps": "false", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_deep_scrub_keys": "1024", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_deep_scrub_stride": "524288", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_default_notify_timeout": "30", 2024-09-16T16:47:05.798 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_delete_sleep": "0.000000", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_discard_disconnected_ops": "true", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_ec_partial_reads": "true", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_enable_op_tracker": "true", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_fast_info": "true", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_fast_shutdown": "true", 2024-09-16T16:47:05.799 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_function_tracing": "false", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_heartbeat_grace": "20", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_heartbeat_interval": "6", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_heartbeat_min_peers": "10", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_heartbeat_min_size": "2000", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_heartbeat_stale": "600", 2024-09-16T16:47:05.800 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_hit_set_max_size": "100000", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_hit_set_min_size": "1000", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_journal_size": "5120", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_kill_backfill_at": "0", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_map_cache_size": "50", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_map_dedup": "true", 2024-09-16T16:47:05.801 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_map_message_max": "40", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_map_share_max_epochs": "40", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_attr_name_len": "100", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_attr_size": "0", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_backfills": "1", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_markdown_count": "5", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_markdown_period": "600", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_object_name_len": "2048", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_object_namespace_len": "256", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_object_size": "134217728", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_pg_blocked_by": "16", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_pg_log_entries": "10000", 2024-09-16T16:47:05.802 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_pgls": "1024", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_push_cost": "8388608", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_push_objects": "10", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_scrubs": "3", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_trimming_pgs": "2", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_write_op_reply_len": "64", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_max_write_size": "90", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-16T16:47:05.803 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_profile": "balanced", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_memory_base": "805306368", 2024-09-16T16:47:05.804 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_memory_cache_min": "134217728", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_memory_target": "4294967296", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_memory_target_autotune": "false", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_min_pg_log_entries": "250", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_min_recovery_priority": "0", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mon_report_interval": "5", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_num_cache_shards": "32", 2024-09-16T16:47:05.805 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_num_op_tracker_shard": "32", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_numa_auto_affinity": "true", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_numa_node": "-1", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_numa_prefer_iface": "true", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_objecter_finishers": "1", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_objectstore": "bluestore", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_objectstore_fuse": "false", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_objectstore_tracing": "false", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_complaint_time": "30.000000", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_history_duration": "600", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_history_size": "20", 2024-09-16T16:47:05.806 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_history_slow_op_size": "20", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_log_threshold": "5", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_num_shards": "0", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_num_shards_hdd": "5", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_num_shards_ssd": "8", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_pq_min_cost": "65536", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_queue_cut_off": "high", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_op_thread_timeout": "15", 2024-09-16T16:47:05.807 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_open_classes_on_start": "true", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_os_flags": "0", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_peering_op_priority": "255", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_delete_cost": "1048576", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_delete_priority": "5", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_log_trim_max": "10000", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_log_trim_min": "100", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-16T16:47:05.808 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_crimson": "true", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-16T16:47:05.809 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_flags": "0", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_min_size": "2", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_pg_num": "32", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_pgp_num": "0", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_read_ratio": "70", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_size": "3", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_default_type": "replicated", 2024-09-16T16:47:05.810 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_push_per_object_cost": "1000", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recover_clone_overlap": "true", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_cost": "20971520", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_max_active": "0", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_max_single_start": "1", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_op_priority": "3", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-16T16:47:05.811 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_priority": "5", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_sleep": "0.000000", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_repair_during_recovery": "false", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_requested_scrub_priority": "120", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_auto_repair": "false", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_begin_hour": "0", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_begin_week_day": "0", 2024-09-16T16:47:05.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_chunk_max": "25", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_chunk_min": "5", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_cost": "52428800", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_during_recovery": "false", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_end_hour": "0", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_end_week_day": "0", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_event_cost": "4096", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_invalid_stats": "true", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_max_preemptions": "5", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-16T16:47:05.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_priority": "5", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_retry_delay": "30", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_retry_trimming": "10", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_scrub_sleep": "0.000000", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_skip_data_digest": "false", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_smart_report_timeout": "5", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_snap_trim_cost": "1048576", 2024-09-16T16:47:05.814 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_snap_trim_priority": "5", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_target_transaction_size": "30", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-16T16:47:05.815 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_tracing": "false", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_use_stale_snap": "false", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "osdc_blkin_trace_all": "false", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_kill_at": "0", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_max_join_drift": "10", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_min": "500", 2024-09-16T16:47:05.816 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_min_wait": "0.050000", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_propose_interval": "1.000000", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_service_trim_max": "500", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_service_trim_min": "10", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_stash_full_interval": "25", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_trim_max": "500", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "paxos_trim_min": "250", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "perf": "true", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addr": "-", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "public_addrv": "", 2024-09-16T16:47:05.817 INFO:teuthology.orchestra.run.smithi002.stdout: "public_bind_addr": "-", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "public_network": "", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "public_network_interface": "", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "qat_compressor_busy_polling": "false", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "qat_compressor_enabled": "false", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "qat_compressor_session_max_number": "256", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rados_mon_op_timeout": "0", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rados_osd_op_timeout": "0", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rados_tracing": "false", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_atime_update_interval": "60", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_balance_parent_reads": "false", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_balance_snap_reads": "false", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_blkin_trace_all": "false", 2024-09-16T16:47:05.818 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache": "true", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_policy": "writearound", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_size": "33554432", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_clone_copy_on_read": "false", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_compression_hint": "none", 2024-09-16T16:47:05.819 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_concurrent_management_ops": "10", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_clone_format": "auto", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_data_pool": "", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_features": "61", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_format": "2", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_map_options": "", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_order": "22", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_pool": "rbd", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_stripe_count": "0", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_default_stripe_unit": "0", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-16T16:47:05.820 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_enable_alloc_hint": "true", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_io_scheduler": "simple", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-16T16:47:05.821 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_order": "24", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_pool": "", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_journal_splay_width": "4", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_localize_parent_reads": "false", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_localize_snap_reads": "false", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-16T16:47:05.822 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-16T16:47:05.823 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_mtime_update_interval": "60", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_non_blocking_aio": "true", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_op_thread_timeout": "60", 2024-09-16T16:47:05.824 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_op_threads": "1", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_parent_cache_enabled": "false", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_plugins": "", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_bps_burst": "0", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_bps_limit": "0", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_exclude_ops": "0", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_iops_burst": "0", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_iops_limit": "0", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-16T16:47:05.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_read_from_replica_policy": "default", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-16T16:47:05.826 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_skip_partial_discard": "true", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_tracing": "false", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_validate_names": "true", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_validate_pool": "true", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "restapi_base_url": "", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "restapi_log_level": "", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_acl_grants_max_num": "100", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_admin_entry": "admin", 2024-09-16T16:47:05.827 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_asio_assert_yielding": "false", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_backend_store": "rados", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_barbican_url": "", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_beast_enable_async": "true", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_counters_cache": "false", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_cache_enabled": "true", 2024-09-16T16:47:05.828 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_cache_expiry_interval": "900", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_cache_lru_size": "25000", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_config_store": "rados", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_content_length_compat": "false", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_copy_obj_progress": "true", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_cors_rules_max_num": "100", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_cross_domain_policy": "", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_addr": "", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-16T16:47:05.829 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_password": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_kmip_username": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_require_ssl": "true", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-16T16:47:05.830 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_addr": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_auth": "token", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_namespace": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_prefix": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-16T16:47:05.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_token_file": "", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_curl_buffersize": "524288", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_curl_low_speed_time": "300", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-16T16:47:05.832 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-16T16:47:05.833 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data_log_changes_size": "1000", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data_log_num_shards": "128", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data_log_window": "30", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-16T16:47:05.834 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_disable_s3select": "false", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-16T16:47:05.835 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dns_name": "", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dns_s3website_name": "", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dynamic_resharding": "true", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_gc_threads": "true", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_lc_threads": "true", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_mdsearch": "true", 2024-09-16T16:47:05.836 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_ops_log": "false", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_quota_threads": "true", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_static_website": "false", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enable_usage_log": "false", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_enforce_swift_acls": "true", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_exit_timeout_secs": "120", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_expose_bucket": "false", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_extended_http_attrs": "", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_filter": "none", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_frontends": "beast port=7480", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-16T16:47:05.837 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_max_deferred": "50", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_max_objs": "32", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_gc_processor_period": "3600", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_init_timeout": "300", 2024-09-16T16:47:05.838 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_kafka_connection_idle": "300", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_domain": "", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_password": "", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_password_path": "", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_project": "", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_tenant": "", 2024-09-16T16:47:05.839 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_token": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_token_path": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_admin_user": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_barbican_domain": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_barbican_password": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_barbican_project": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_barbican_user": "", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-16T16:47:05.840 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_url": "", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lc_debug_interval": "-1", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lc_lock_max_time": "90", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lc_max_objs": "32", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lc_max_rules": "1000", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lc_max_worker": "3", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lc_thread_delay": "0", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ldap_dnattr": "uid", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-16T16:47:05.841 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ldap_searchfilter": "", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ldap_uri": "", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_log_http_headers": "", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_log_object_name_utc": "false", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_attr_name_len": "0", 2024-09-16T16:47:05.842 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_attr_size": "0", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_chunk_size": "4194304", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_listing_results": "5000", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_notify_retries": "10", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_put_param_size": "1048576", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_put_size": "5368709120", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_max_slo_entries": "1000", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_md_log_max_shards": "64", 2024-09-16T16:47:05.843 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_mp_lock_max_time": "600", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-16T16:47:05.844 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_max_gc": "300", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_num_async_rados_threads": "32", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_num_control_oids": "8", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_numa_node": "-1", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-16T16:47:05.845 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_objexp_chunk_size": "100", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_objexp_gc_interval": "600", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_op_thread_timeout": "600", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_op_tracing": "false", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_opa_token": "", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_opa_url": "", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_opa_verify_ssl": "true", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ops_log_rados": "false", 2024-09-16T16:47:05.846 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_ops_log_socket_path": "", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_period_push_interval": "2.000000", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_posix_cache_lanes": "3", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_posix_cache_partitions": "3", 2024-09-16T16:47:05.847 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_print_continue": "true", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_rados_tracing": "false", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_realm": "", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_realm_id": "", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_region": "", 2024-09-16T16:47:05.848 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_request_uri": "", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_batch_size": "64", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_max_aio": "128", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_num_logs": "16", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshard_thread_interval": "600", 2024-09-16T16:47:05.849 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_resolve_cname": "false", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_run_sync_thread": "true", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_scheduler_type": "throttler", 2024-09-16T16:47:05.850 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_script_uri": "", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_service_provider_name": "", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sts_client_id": "", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sts_client_secret": "", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sts_entry": "sts", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sts_key": "sts", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sts_min_session_duration": "900", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sts_token_introspection_url": "", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_account_in_url": "false", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_auth_entry": "auth", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_auth_url": "", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_custom_header": "", 2024-09-16T16:47:05.851 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_need_stats": "true", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_tenant_name": "", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_token_expiration": "86400", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_url": "", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_url_prefix": "swift", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_lease_period": "120", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-16T16:47:05.852 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_thread_pool_size": "512", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_comment": "", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_createby": "", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_encoding": "", 2024-09-16T16:47:05.853 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_flag": "false", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_origin": "", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_torrent_tracker": "", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_trust_forwarded_https": "false", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_usage_max_shards": "32", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_usage_max_user_shards": "1", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_use_opa_authz": "false", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_counters_cache": "false", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-16T16:47:05.854 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_max_buckets": "1000", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_policies_max_num": "100", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_user_unique_email": "true", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_verify_ssl": "true", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-16T16:47:05.855 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_zone": "", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_zone_id": "", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_zonegroup": "", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_zonegroup_id": "", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rgwlc_auto_session_clear": "true", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_block_size": "4096", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-16T16:47:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cache_size": "536870912", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_index_type": "binary_search", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-16T16:47:05.857 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_partition_filters": "false", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_perf": "false", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "run_dir": "/var/run/ceph", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_block_create": "true", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_cache_lru_size": "67108864", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_default_max_object_size": "16777216", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_device_size": "53687091200", 2024-09-16T16:47:05.858 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_full_integrity_check": "false", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_journal_batch_capacity": "16", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_main_device_type": "SSD", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-16T16:47:05.859 INFO:teuthology.orchestra.run.smithi002.stdout: "seastore_segment_size": "67108864", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "set_keepcaps": "false", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "setgroup": "", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "setuser": "", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "setuser_match_path": "", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "thp": "false", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "threadpool_default_timeout": "60", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "throttler_perf_counter": "true", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tmp_dir": "/tmp", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "uadk_compressor_enabled": "false", 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-16T16:47:05.860 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-16T16:47:05.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-16T16:47:05.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:05.970+0000 7f2da1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:05.977+0000 7f2da1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:05.992 INFO:teuthology.orchestra.run.smithi002.stdout:{} 2024-09-16T16:47:05.993 INFO:teuthology.orchestra.run.smithi002.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T16:47:06.003 DEBUG:teuthology.orchestra.run.smithi002:> type ceph-objectstore-tool 2024-09-16T16:47:06.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T16:47:06.018 DEBUG:teuthology.orchestra.run.smithi110:> type ceph-objectstore-tool 2024-09-16T16:47:06.036 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T16:47:06.036 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-16T16:47:06.045 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:47:06.047 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:47:06.047 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-16T16:47:06.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-16T16:47:06.047 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-16T16:47:06.048 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:06.048 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:06.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:06.048 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-16T16:47:06.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:06.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:06.172+0000 7f7b78f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:06.172+0000 7f59e3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:06.179+0000 7f7b78f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:06.172+0000 7f955ab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:06.182+0000 7f59e3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:06.189+0000 7f955ab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:06.395 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:06.408 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-09-16T16:47:06.366227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.587972"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_0' created 2024-09-16T16:47:07.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-16T16:47:07.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:07.377+0000 7f7cc707f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:07.391+0000 7f7cc707f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:08.204 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-16T16:47:08.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:08.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:08.465+0000 7fcbc3711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:08.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:08.473+0000 7fcbc3711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:09.223 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-16T16:47:09.226 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:47:09.226 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:47:09.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:47:09.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:47:09.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_29843 2024-09-16T16:47:09.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:47:09.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:47:10.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 135 119 0.929632 0.929688 0.111401 0.126542 2024-09-16T16:47:10.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:10.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:10.740+0000 7fa88aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:10.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:10.748+0000 7fa88aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:11.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 251 235 0.917889 0.90625 0.0275511 0.13174 2024-09-16T16:47:11.409 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:11.410 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:11.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:11.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:11.553+0000 7fbff405c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:11.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:11.568+0000 7fbff405c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:11.843 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:11.859 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-16T16:47:10.366955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001062"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:12.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 360 344 0.895754 0.851562 0.446915 0.134592 2024-09-16T16:47:12.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:13.134+0000 7fc09c046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:13.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:13.143+0000 7fc09c046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:13.295 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 16 490 474 0.925698 1.01562 0.121446 0.133046 2024-09-16T16:47:14.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 590 574 0.896791 0.78125 0.149775 0.137525 2024-09-16T16:47:15.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 710 694 0.90356 0.9375 0.113983 0.136857 2024-09-16T16:47:15.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:15.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:15.645+0000 7f768c6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:15.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:15.652+0000 7f768c6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:16.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 789 773 0.86264 0.617188 0.0664149 0.142693 2024-09-16T16:47:16.861 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:16.862 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:16.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:16.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:16.983+0000 7f9602246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:16.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:16.993+0000 7f9602246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:17.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 894 878 0.857338 0.820312 0.289267 0.143041 2024-09-16T16:47:17.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:17.400 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-16T16:47:16.368142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.162904"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:17.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:17.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:17.945+0000 7f6c6d8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:17.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:17.953+0000 7f6c6d8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:18.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 985 969 0.841065 0.710938 0.299802 0.145905 2024-09-16T16:47:19.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 1115 1099 0.858512 1.01562 0.250567 0.144546 2024-09-16T16:47:20.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:20.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:20.290+0000 7f5e34a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:20.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1228 1212 0.860714 0.882812 0.24421 0.144066 2024-09-16T16:47:20.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:20.297+0000 7f5e34a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:21.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1355 1339 0.871663 0.992188 0.193045 0.142316 2024-09-16T16:47:22.296 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1471 1455 0.874317 0.90625 0.134709 0.142066 2024-09-16T16:47:22.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:22.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:22.403 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:22.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:22.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:22.534+0000 7fa06e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:22.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:22.545+0000 7fa06e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:22.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:22.642+0000 7f722ed11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:22.652+0000 7f722ed11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:22.849 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:22.849 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:22.873 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T16:47:22.369261+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":5144,"kb_used_data":5144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209185768,"statfs":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002306"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":91,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.203354+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:01.203354+0000","last_peered":"2024-09-16T16:47:01.203354+0000","last_clean":"2024-09-16T16:47:01.203354+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:01.203354+0000","last_undegraded":"2024-09-16T16:47:01.203354+0000","last_fullsized":"2024-09-16T16:47:01.203354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213653+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:01.213653+0000","last_peered":"2024-09-16T16:47:01.213653+0000","last_clean":"2024-09-16T16:47:01.213653+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:01.213653+0000","last_undegraded":"2024-09-16T16:47:01.213653+0000","last_fullsized":"2024-09-16T16:47:01.213653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.214495+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:01.214495+0000","last_peered":"2024-09-16T16:47:01.214495+0000","last_clean":"2024-09-16T16:47:01.214495+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:01.214495+0000","last_undegraded":"2024-09-16T16:47:01.214495+0000","last_fullsized":"2024-09-16T16:47:01.214495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.207332+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:01.207332+0000","last_peered":"2024-09-16T16:47:01.207332+0000","last_clean":"2024-09-16T16:47:01.207332+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:01.207332+0000","last_undegraded":"2024-09-16T16:47:01.207332+0000","last_fullsized":"2024-09-16T16:47:01.207332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.211386+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:01.211386+0000","last_peered":"2024-09-16T16:47:01.211386+0000","last_clean":"2024-09-16T16:47:01.211386+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:01.211386+0000","last_undegraded":"2024-09-16T16:47:01.211386+0000","last_fullsized":"2024-09-16T16:47:01.211386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206505+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:01.206505+0000","last_peered":"2024-09-16T16:47:01.206505+0000","last_clean":"2024-09-16T16:47:01.206505+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:01.206505+0000","last_undegraded":"2024-09-16T16:47:01.206505+0000","last_fullsized":"2024-09-16T16:47:01.206505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206500+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:01.206500+0000","last_peered":"2024-09-16T16:47:01.206500+0000","last_clean":"2024-09-16T16:47:01.206500+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:01.206500+0000","last_undegraded":"2024-09-16T16:47:01.206500+0000","last_fullsized":"2024-09-16T16:47:01.206500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.206871+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:01.206871+0000","last_peered":"2024-09-16T16:47:01.206871+0000","last_clean":"2024-09-16T16:47:01.206871+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:01.206871+0000","last_undegraded":"2024-09-16T16:47:01.206871+0000","last_fullsized":"2024-09-16T16:47:01.206871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:47:07.199648+0000","last_change":"2024-09-16T16:47:07.199648+0000","last_active":"2024-09-16T16:47:07.199648+0000","last_peered":"2024-09-16T16:47:07.199648+0000","last_clean":"2024-09-16T16:47:07.199648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:47:07.199648+0000","last_undegraded":"2024-09-16T16:47:07.199648+0000","last_fullsized":"2024-09-16T16:47:07.199648+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T16:47:01.213497+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:01.213497+0000","last_peered":"2024-09-16T16:47:01.213497+0000","last_clean":"2024-09-16T16:47:01.213497+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:01.213497+0000","last_undegraded":"2024-09-16T16:47:01.213497+0000","last_fullsized":"2024-09-16T16:47:01.213497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214206226432,"internally_reserved":0,"allocated":5267456,"data_stored":5267456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1252,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296476,"statfs":{"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1640,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296088,"statfs":{"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":676,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297052,"statfs":{"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1576,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296152,"statfs":{"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551259648,"internally_reserved":0,"allocated":1613824,"data_stored":1613824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552181248,"internally_reserved":0,"allocated":692224,"data_stored":692224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551194112,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551591424,"internally_reserved":0,"allocated":1282048,"data_stored":1282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:23.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1582 1566 0.873802 0.867188 0.20121 0.142254 2024-09-16T16:47:24.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1693 1677 0.873355 0.867188 0.0622501 0.142305 2024-09-16T16:47:24.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:25.009+0000 7f2fad64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:25.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:25.019+0000 7f2fad64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:25.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1822 1806 0.881753 1.00781 0.183556 0.141141 2024-09-16T16:47:26.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1943 1927 0.885486 0.945312 0.163144 0.140663 2024-09-16T16:47:27.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:27.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 2069 2053 0.890975 0.984375 0.114995 0.139666 2024-09-16T16:47:27.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:27.364+0000 7fd0ec991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:27.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:27.372+0000 7fd0ec991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:27.875 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:27.876 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:27.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:28.040+0000 7f8776f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:28.052+0000 7f8776f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:28.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 2177 2161 0.888485 0.84375 0.147034 0.140102 2024-09-16T16:47:28.363 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:28.363 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:28.383 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-16T16:47:26.369844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14541363,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1784,"num_write_kb":14732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":89480,"kb_used_data":89480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209101432,"statfs":{"total":214211493888,"available":214119866368,"internally_reserved":0,"allocated":91627520,"data_stored":91627520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13950976,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1703,"num_write_kb":13624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002158"},"pg_stats":[{"pgid":"3.f","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.971748+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:23.971748+0000","last_peered":"2024-09-16T16:47:23.971748+0000","last_clean":"2024-09-16T16:47:23.971748+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:23.971748+0000","last_undegraded":"2024-09-16T16:47:23.971748+0000","last_fullsized":"2024-09-16T16:47:23.971748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.158443+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:23.158443+0000","last_peered":"2024-09-16T16:47:23.158443+0000","last_clean":"2024-09-16T16:47:23.158443+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:23.158443+0000","last_undegraded":"2024-09-16T16:47:23.158443+0000","last_fullsized":"2024-09-16T16:47:23.158443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'96","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:20.714256+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:20.714256+0000","last_peered":"2024-09-16T16:47:20.714256+0000","last_clean":"2024-09-16T16:47:20.714256+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:20.714256+0000","last_undegraded":"2024-09-16T16:47:20.714256+0000","last_fullsized":"2024-09-16T16:47:20.714256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'112","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.105605+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:24.105605+0000","last_peered":"2024-09-16T16:47:24.105605+0000","last_clean":"2024-09-16T16:47:24.105605+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:24.105605+0000","last_undegraded":"2024-09-16T16:47:24.105605+0000","last_fullsized":"2024-09-16T16:47:24.105605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'128","reported_seq":140,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.212689+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:24.212689+0000","last_peered":"2024-09-16T16:47:24.212689+0000","last_clean":"2024-09-16T16:47:24.212689+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:24.212689+0000","last_undegraded":"2024-09-16T16:47:24.212689+0000","last_fullsized":"2024-09-16T16:47:24.212689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'136","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.899711+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:22.899711+0000","last_peered":"2024-09-16T16:47:22.899711+0000","last_clean":"2024-09-16T16:47:22.899711+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:22.899711+0000","last_undegraded":"2024-09-16T16:47:22.899711+0000","last_fullsized":"2024-09-16T16:47:22.899711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'128","reported_seq":140,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.841008+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:23.841008+0000","last_peered":"2024-09-16T16:47:23.841008+0000","last_clean":"2024-09-16T16:47:23.841008+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:23.841008+0000","last_undegraded":"2024-09-16T16:47:23.841008+0000","last_fullsized":"2024-09-16T16:47:23.841008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.800632+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:23.800632+0000","last_peered":"2024-09-16T16:47:23.800632+0000","last_clean":"2024-09-16T16:47:23.800632+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:23.800632+0000","last_undegraded":"2024-09-16T16:47:23.800632+0000","last_fullsized":"2024-09-16T16:47:23.800632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'127","reported_seq":139,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.371783+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:24.371783+0000","last_peered":"2024-09-16T16:47:24.371783+0000","last_clean":"2024-09-16T16:47:24.371783+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:24.371783+0000","last_undegraded":"2024-09-16T16:47:24.371783+0000","last_fullsized":"2024-09-16T16:47:24.371783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1040384,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'104","reported_seq":116,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.624989+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:22.624989+0000","last_peered":"2024-09-16T16:47:22.624989+0000","last_clean":"2024-09-16T16:47:22.624989+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:22.624989+0000","last_undegraded":"2024-09-16T16:47:22.624989+0000","last_fullsized":"2024-09-16T16:47:22.624989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'88","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.834278+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:22.834278+0000","last_peered":"2024-09-16T16:47:22.834278+0000","last_clean":"2024-09-16T16:47:22.834278+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:22.834278+0000","last_undegraded":"2024-09-16T16:47:22.834278+0000","last_fullsized":"2024-09-16T16:47:22.834278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'120","reported_seq":132,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.659705+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:23.659705+0000","last_peered":"2024-09-16T16:47:23.659705+0000","last_clean":"2024-09-16T16:47:23.659705+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:23.659705+0000","last_undegraded":"2024-09-16T16:47:23.659705+0000","last_fullsized":"2024-09-16T16:47:23.659705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'136","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.417115+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:23.417115+0000","last_peered":"2024-09-16T16:47:23.417115+0000","last_clean":"2024-09-16T16:47:23.417115+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:23.417115+0000","last_undegraded":"2024-09-16T16:47:23.417115+0000","last_fullsized":"2024-09-16T16:47:23.417115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'112","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.317683+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:24.317683+0000","last_peered":"2024-09-16T16:47:24.317683+0000","last_clean":"2024-09-16T16:47:24.317683+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:24.317683+0000","last_undegraded":"2024-09-16T16:47:24.317683+0000","last_fullsized":"2024-09-16T16:47:24.317683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'104","reported_seq":116,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.277396+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:24.277396+0000","last_peered":"2024-09-16T16:47:24.277396+0000","last_clean":"2024-09-16T16:47:24.277396+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:24.277396+0000","last_undegraded":"2024-09-16T16:47:24.277396+0000","last_fullsized":"2024-09-16T16:47:24.277396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'72","reported_seq":84,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.725321+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:23.725321+0000","last_peered":"2024-09-16T16:47:23.725321+0000","last_clean":"2024-09-16T16:47:23.725321+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:23.725321+0000","last_undegraded":"2024-09-16T16:47:23.725321+0000","last_fullsized":"2024-09-16T16:47:23.725321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":13950976,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1703,"num_write_kb":13624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214118748160,"internally_reserved":0,"allocated":92745728,"data_stored":92745728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1703,"ondisk_log_size":1703,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214118748160,"internally_reserved":0,"allocated":92745728,"data_stored":92745728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53526908928,"internally_reserved":0,"allocated":25964544,"data_stored":25964544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24964,"kb_used_data":24964,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272764,"statfs":{"total":53552873472,"available":53527310336,"internally_reserved":0,"allocated":25563136,"data_stored":25563136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21452,"kb_used_data":21452,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52276276,"statfs":{"total":53552873472,"available":53530906624,"internally_reserved":0,"allocated":21966848,"data_stored":21966848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21092,"kb_used_data":21092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52276636,"statfs":{"total":53552873472,"available":53531275264,"internally_reserved":0,"allocated":21598208,"data_stored":21598208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21972,"kb_used_data":21972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275756,"statfs":{"total":53552873472,"available":53530374144,"internally_reserved":0,"allocated":22499328,"data_stored":22499328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53526908928,"internally_reserved":0,"allocated":25964544,"data_stored":25964544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53529944064,"internally_reserved":0,"allocated":22929408,"data_stored":22929408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53531144192,"internally_reserved":0,"allocated":21729280,"data_stored":21729280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53530759168,"internally_reserved":0,"allocated":22114304,"data_stored":22114304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53526900736,"internally_reserved":0,"allocated":25972736,"data_stored":25972736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53529944064,"internally_reserved":0,"allocated":22929408,"data_stored":22929408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53531144192,"internally_reserved":0,"allocated":21729280,"data_stored":21729280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53530759168,"internally_reserved":0,"allocated":22114304,"data_stored":22114304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53526900736,"internally_reserved":0,"allocated":25972736,"data_stored":25972736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:29.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:47:29.297976+0000 min lat: 0.0185597 max lat: 0.637425 avg lat: 0.139173 2024-09-16T16:47:29.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:47:29.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2304 2288 0.893665 0.992188 0.128901 0.139173 2024-09-16T16:47:29.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:29.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:29.787+0000 7fddf7e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:29.797+0000 7fddf7e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:30.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 16 2432 2416 0.898723 1 0.162773 0.138429 2024-09-16T16:47:31.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2544 2528 0.897641 0.875 0.144847 0.138837 2024-09-16T16:47:32.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:32.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:32.170+0000 7f98f8311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:32.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:32.178+0000 7f98f8311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:32.297 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2674 2658 0.902767 1.01562 0.149063 0.138145 2024-09-16T16:47:33.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2774 2758 0.8977 0.78125 0.173105 0.138649 2024-09-16T16:47:33.385 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:33.385 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:33.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:33.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:33.506+0000 7f135e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:33.518+0000 7f135e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:33.771 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:33.772 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:33.786 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-16T16:47:32.370966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14541363,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1784,"num_write_kb":14732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":89480,"kb_used_data":89480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209101432,"statfs":{"total":214211493888,"available":214119866368,"internally_reserved":0,"allocated":91627520,"data_stored":91627520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13950976,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1703,"num_write_kb":13624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002021"},"pg_stats":[{"pgid":"3.f","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.971748+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:23.971748+0000","last_peered":"2024-09-16T16:47:23.971748+0000","last_clean":"2024-09-16T16:47:23.971748+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:23.971748+0000","last_undegraded":"2024-09-16T16:47:23.971748+0000","last_fullsized":"2024-09-16T16:47:23.971748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.158443+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:23.158443+0000","last_peered":"2024-09-16T16:47:23.158443+0000","last_clean":"2024-09-16T16:47:23.158443+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:23.158443+0000","last_undegraded":"2024-09-16T16:47:23.158443+0000","last_fullsized":"2024-09-16T16:47:23.158443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'96","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:20.714256+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:20.714256+0000","last_peered":"2024-09-16T16:47:20.714256+0000","last_clean":"2024-09-16T16:47:20.714256+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:20.714256+0000","last_undegraded":"2024-09-16T16:47:20.714256+0000","last_fullsized":"2024-09-16T16:47:20.714256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'112","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.105605+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:24.105605+0000","last_peered":"2024-09-16T16:47:24.105605+0000","last_clean":"2024-09-16T16:47:24.105605+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:24.105605+0000","last_undegraded":"2024-09-16T16:47:24.105605+0000","last_fullsized":"2024-09-16T16:47:24.105605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'128","reported_seq":140,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.212689+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:24.212689+0000","last_peered":"2024-09-16T16:47:24.212689+0000","last_clean":"2024-09-16T16:47:24.212689+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:24.212689+0000","last_undegraded":"2024-09-16T16:47:24.212689+0000","last_fullsized":"2024-09-16T16:47:24.212689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'136","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.899711+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:22.899711+0000","last_peered":"2024-09-16T16:47:22.899711+0000","last_clean":"2024-09-16T16:47:22.899711+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:22.899711+0000","last_undegraded":"2024-09-16T16:47:22.899711+0000","last_fullsized":"2024-09-16T16:47:22.899711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'128","reported_seq":140,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.841008+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:23.841008+0000","last_peered":"2024-09-16T16:47:23.841008+0000","last_clean":"2024-09-16T16:47:23.841008+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:23.841008+0000","last_undegraded":"2024-09-16T16:47:23.841008+0000","last_fullsized":"2024-09-16T16:47:23.841008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.800632+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:23.800632+0000","last_peered":"2024-09-16T16:47:23.800632+0000","last_clean":"2024-09-16T16:47:23.800632+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:23.800632+0000","last_undegraded":"2024-09-16T16:47:23.800632+0000","last_fullsized":"2024-09-16T16:47:23.800632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'127","reported_seq":139,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.371783+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:24.371783+0000","last_peered":"2024-09-16T16:47:24.371783+0000","last_clean":"2024-09-16T16:47:24.371783+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:24.371783+0000","last_undegraded":"2024-09-16T16:47:24.371783+0000","last_fullsized":"2024-09-16T16:47:24.371783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1040384,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'104","reported_seq":116,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.624989+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:22.624989+0000","last_peered":"2024-09-16T16:47:22.624989+0000","last_clean":"2024-09-16T16:47:22.624989+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:22.624989+0000","last_undegraded":"2024-09-16T16:47:22.624989+0000","last_fullsized":"2024-09-16T16:47:22.624989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'88","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.834278+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:22.834278+0000","last_peered":"2024-09-16T16:47:22.834278+0000","last_clean":"2024-09-16T16:47:22.834278+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:22.834278+0000","last_undegraded":"2024-09-16T16:47:22.834278+0000","last_fullsized":"2024-09-16T16:47:22.834278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'120","reported_seq":132,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.659705+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:23.659705+0000","last_peered":"2024-09-16T16:47:23.659705+0000","last_clean":"2024-09-16T16:47:23.659705+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:23.659705+0000","last_undegraded":"2024-09-16T16:47:23.659705+0000","last_fullsized":"2024-09-16T16:47:23.659705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'136","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.417115+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:23.417115+0000","last_peered":"2024-09-16T16:47:23.417115+0000","last_clean":"2024-09-16T16:47:23.417115+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:23.417115+0000","last_undegraded":"2024-09-16T16:47:23.417115+0000","last_fullsized":"2024-09-16T16:47:23.417115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'112","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.317683+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:24.317683+0000","last_peered":"2024-09-16T16:47:24.317683+0000","last_clean":"2024-09-16T16:47:24.317683+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:24.317683+0000","last_undegraded":"2024-09-16T16:47:24.317683+0000","last_fullsized":"2024-09-16T16:47:24.317683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'104","reported_seq":116,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.277396+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:24.277396+0000","last_peered":"2024-09-16T16:47:24.277396+0000","last_clean":"2024-09-16T16:47:24.277396+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:24.277396+0000","last_undegraded":"2024-09-16T16:47:24.277396+0000","last_fullsized":"2024-09-16T16:47:24.277396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'72","reported_seq":84,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.725321+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:23.725321+0000","last_peered":"2024-09-16T16:47:23.725321+0000","last_clean":"2024-09-16T16:47:23.725321+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:23.725321+0000","last_undegraded":"2024-09-16T16:47:23.725321+0000","last_fullsized":"2024-09-16T16:47:23.725321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":13950976,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1703,"num_write_kb":13624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214118748160,"internally_reserved":0,"allocated":92745728,"data_stored":92745728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1703,"ondisk_log_size":1703,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214118748160,"internally_reserved":0,"allocated":92745728,"data_stored":92745728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53526908928,"internally_reserved":0,"allocated":25964544,"data_stored":25964544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24964,"kb_used_data":24964,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272764,"statfs":{"total":53552873472,"available":53527310336,"internally_reserved":0,"allocated":25563136,"data_stored":25563136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21452,"kb_used_data":21452,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52276276,"statfs":{"total":53552873472,"available":53530906624,"internally_reserved":0,"allocated":21966848,"data_stored":21966848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21092,"kb_used_data":21092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52276636,"statfs":{"total":53552873472,"available":53531275264,"internally_reserved":0,"allocated":21598208,"data_stored":21598208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21972,"kb_used_data":21972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275756,"statfs":{"total":53552873472,"available":53530374144,"internally_reserved":0,"allocated":22499328,"data_stored":22499328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53526908928,"internally_reserved":0,"allocated":25964544,"data_stored":25964544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53529944064,"internally_reserved":0,"allocated":22929408,"data_stored":22929408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53531144192,"internally_reserved":0,"allocated":21729280,"data_stored":21729280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53530759168,"internally_reserved":0,"allocated":22114304,"data_stored":22114304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53526900736,"internally_reserved":0,"allocated":25972736,"data_stored":25972736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53529944064,"internally_reserved":0,"allocated":22929408,"data_stored":22929408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53531144192,"internally_reserved":0,"allocated":21729280,"data_stored":21729280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53530759168,"internally_reserved":0,"allocated":22114304,"data_stored":22114304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53526900736,"internally_reserved":0,"allocated":25972736,"data_stored":25972736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:34.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2887 2871 0.897101 0.882812 0.146468 0.13893 2024-09-16T16:47:34.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:34.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:34.550+0000 7fab5066c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:34.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:34.557+0000 7fab5066c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:35.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 3007 2991 0.898652 0.9375 0.0872999 0.13878 2024-09-16T16:47:36.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 3122 3106 0.89864 0.898438 0.120895 0.138659 2024-09-16T16:47:36.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:36.973+0000 7f9362d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:36.981+0000 7f9362d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:37.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 3237 3221 0.89863 0.898438 0.107591 0.138794 2024-09-16T16:47:38.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 3345 3329 0.896734 0.84375 0.110116 0.13915 2024-09-16T16:47:38.788 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:38.788 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:38.788 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:47:38.789 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:47:38.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:38.912+0000 7f364acc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:38.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:38.927+0000 7f364acc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:38.948 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:38.948 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:38.948 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:38.952 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:38.953 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:38.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:47:39.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.085+0000 7f8182c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.099+0000 7f8182c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.214 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:39.215 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:39.218 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:39.218 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:39.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:47:39.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 3457 3441 0.896008 0.875 0.123314 0.139062 2024-09-16T16:47:39.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.342+0000 7fdabad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.356+0000 7fdabad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:39.437 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:39.437 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:39.440 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:39.441 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:39.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:47:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.460+0000 7f47c7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.467+0000 7f47c7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.581+0000 7f87608fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:39.593+0000 7f87608fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:39.676 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:39.676 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:39.676 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:39.676 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:39.676 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:39.676 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:39.677 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:39.677 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:39.677 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:39.677 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:39.677 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:39.677 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:39.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:39.680 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:40.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3576 3560 0.897092 0.929688 0.109475 0.139042 2024-09-16T16:47:41.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3693 3677 0.897619 0.914062 0.0462386 0.138881 2024-09-16T16:47:41.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:41.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:41.941+0000 7f6155aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:41.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:41.948+0000 7f6155aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:42.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3791 3775 0.893616 0.765625 0.173107 0.139457 2024-09-16T16:47:43.298 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3911 3895 0.894904 0.9375 0.133738 0.139316 2024-09-16T16:47:44.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:44.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 4013 3997 0.892101 0.796875 0.288633 0.139643 2024-09-16T16:47:44.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:44.325+0000 7f5ea6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:44.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:44.333+0000 7f5ea6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:44.681 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:44.681 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:44.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:47:44.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:44.813+0000 7f103df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:44.822+0000 7f103df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:45.106 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:47:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:47:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-16T16:47:44.373383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14541363,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1784,"num_write_kb":14732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1758,"ondisk_log_size":1758,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":89480,"kb_used_data":89480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209101432,"statfs":{"total":214211493888,"available":214119866368,"internally_reserved":0,"allocated":91627520,"data_stored":91627520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002417"},"pg_stats":[{"pgid":"3.f","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.971748+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:23.971748+0000","last_peered":"2024-09-16T16:47:23.971748+0000","last_clean":"2024-09-16T16:47:23.971748+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:23.971748+0000","last_undegraded":"2024-09-16T16:47:23.971748+0000","last_fullsized":"2024-09-16T16:47:23.971748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.158443+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:23.158443+0000","last_peered":"2024-09-16T16:47:23.158443+0000","last_clean":"2024-09-16T16:47:23.158443+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:23.158443+0000","last_undegraded":"2024-09-16T16:47:23.158443+0000","last_fullsized":"2024-09-16T16:47:23.158443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'96","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:20.714256+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:20.714256+0000","last_peered":"2024-09-16T16:47:20.714256+0000","last_clean":"2024-09-16T16:47:20.714256+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:20.714256+0000","last_undegraded":"2024-09-16T16:47:20.714256+0000","last_fullsized":"2024-09-16T16:47:20.714256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'112","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.105605+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:24.105605+0000","last_peered":"2024-09-16T16:47:24.105605+0000","last_clean":"2024-09-16T16:47:24.105605+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:24.105605+0000","last_undegraded":"2024-09-16T16:47:24.105605+0000","last_fullsized":"2024-09-16T16:47:24.105605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'128","reported_seq":140,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.212689+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:24.212689+0000","last_peered":"2024-09-16T16:47:24.212689+0000","last_clean":"2024-09-16T16:47:24.212689+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:24.212689+0000","last_undegraded":"2024-09-16T16:47:24.212689+0000","last_fullsized":"2024-09-16T16:47:24.212689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'136","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.899711+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:22.899711+0000","last_peered":"2024-09-16T16:47:22.899711+0000","last_clean":"2024-09-16T16:47:22.899711+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:22.899711+0000","last_undegraded":"2024-09-16T16:47:22.899711+0000","last_fullsized":"2024-09-16T16:47:22.899711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'128","reported_seq":140,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.841008+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:23.841008+0000","last_peered":"2024-09-16T16:47:23.841008+0000","last_clean":"2024-09-16T16:47:23.841008+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:23.841008+0000","last_undegraded":"2024-09-16T16:47:23.841008+0000","last_fullsized":"2024-09-16T16:47:23.841008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'80","reported_seq":92,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.800632+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:23.800632+0000","last_peered":"2024-09-16T16:47:23.800632+0000","last_clean":"2024-09-16T16:47:23.800632+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:23.800632+0000","last_undegraded":"2024-09-16T16:47:23.800632+0000","last_fullsized":"2024-09-16T16:47:23.800632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'127","reported_seq":139,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.371783+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:24.371783+0000","last_peered":"2024-09-16T16:47:24.371783+0000","last_clean":"2024-09-16T16:47:24.371783+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:24.371783+0000","last_undegraded":"2024-09-16T16:47:24.371783+0000","last_fullsized":"2024-09-16T16:47:24.371783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1040384,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":1016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'104","reported_seq":116,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.624989+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:22.624989+0000","last_peered":"2024-09-16T16:47:22.624989+0000","last_clean":"2024-09-16T16:47:22.624989+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:22.624989+0000","last_undegraded":"2024-09-16T16:47:22.624989+0000","last_fullsized":"2024-09-16T16:47:22.624989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'88","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:22.834278+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:22.834278+0000","last_peered":"2024-09-16T16:47:22.834278+0000","last_clean":"2024-09-16T16:47:22.834278+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:22.834278+0000","last_undegraded":"2024-09-16T16:47:22.834278+0000","last_fullsized":"2024-09-16T16:47:22.834278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'120","reported_seq":132,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.659705+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:23.659705+0000","last_peered":"2024-09-16T16:47:23.659705+0000","last_clean":"2024-09-16T16:47:23.659705+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:23.659705+0000","last_undegraded":"2024-09-16T16:47:23.659705+0000","last_fullsized":"2024-09-16T16:47:23.659705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'136","reported_seq":148,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.417115+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:23.417115+0000","last_peered":"2024-09-16T16:47:23.417115+0000","last_clean":"2024-09-16T16:47:23.417115+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:23.417115+0000","last_undegraded":"2024-09-16T16:47:23.417115+0000","last_fullsized":"2024-09-16T16:47:23.417115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'112","reported_seq":124,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.317683+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:24.317683+0000","last_peered":"2024-09-16T16:47:24.317683+0000","last_clean":"2024-09-16T16:47:24.317683+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:24.317683+0000","last_undegraded":"2024-09-16T16:47:24.317683+0000","last_fullsized":"2024-09-16T16:47:24.317683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'104","reported_seq":116,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:24.277396+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:24.277396+0000","last_peered":"2024-09-16T16:47:24.277396+0000","last_clean":"2024-09-16T16:47:24.277396+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:24.277396+0000","last_undegraded":"2024-09-16T16:47:24.277396+0000","last_fullsized":"2024-09-16T16:47:24.277396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'72","reported_seq":84,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:23.725321+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:23.725321+0000","last_peered":"2024-09-16T16:47:23.725321+0000","last_clean":"2024-09-16T16:47:23.725321+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:23.725321+0000","last_undegraded":"2024-09-16T16:47:23.725321+0000","last_fullsized":"2024-09-16T16:47:23.725321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":13950976,"num_objects":213,"num_object_clones":0,"num_object_copies":639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1703,"num_write_kb":13624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214118748160,"internally_reserved":0,"allocated":92745728,"data_stored":92745728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1703,"ondisk_log_size":1703,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214118748160,"internally_reserved":0,"allocated":92745728,"data_stored":92745728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53526908928,"internally_reserved":0,"allocated":25964544,"data_stored":25964544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24964,"kb_used_data":24964,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272764,"statfs":{"total":53552873472,"available":53527310336,"internally_reserved":0,"allocated":25563136,"data_stored":25563136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21452,"kb_used_data":21452,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52276276,"statfs":{"total":53552873472,"available":53530906624,"internally_reserved":0,"allocated":21966848,"data_stored":21966848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21092,"kb_used_data":21092,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52276636,"statfs":{"total":53552873472,"available":53531275264,"internally_reserved":0,"allocated":21598208,"data_stored":21598208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":21972,"kb_used_data":21972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52275756,"statfs":{"total":53552873472,"available":53530374144,"internally_reserved":0,"allocated":22499328,"data_stored":22499328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53526908928,"internally_reserved":0,"allocated":25964544,"data_stored":25964544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53529944064,"internally_reserved":0,"allocated":22929408,"data_stored":22929408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53531144192,"internally_reserved":0,"allocated":21729280,"data_stored":21729280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53530759168,"internally_reserved":0,"allocated":22114304,"data_stored":22114304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53526900736,"internally_reserved":0,"allocated":25972736,"data_stored":25972736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53529944064,"internally_reserved":0,"allocated":22929408,"data_stored":22929408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53531144192,"internally_reserved":0,"allocated":21729280,"data_stored":21729280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53530759168,"internally_reserved":0,"allocated":22114304,"data_stored":22114304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53526900736,"internally_reserved":0,"allocated":25972736,"data_stored":25972736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:47:45.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 4115 4099 0.889454 0.796875 0.148755 0.140111 2024-09-16T16:47:46.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 4244 4228 0.89265 1.00781 0.0552017 0.139851 2024-09-16T16:47:46.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:46.805+0000 7f03c004f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:46.814+0000 7f03c004f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:47.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 4341 4325 0.8891 0.757812 0.0342588 0.139987 2024-09-16T16:47:48.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 4457 4441 0.889537 0.90625 0.21548 0.140217 2024-09-16T16:47:49.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:49.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:49.270+0000 7f83d2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:49.282+0000 7f83d2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:49.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:47:49.299930+0000 min lat: 0.0185597 max lat: 0.637425 avg lat: 0.139883 2024-09-16T16:47:49.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:47:49.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4585 4569 0.892297 1 0.127623 0.139883 2024-09-16T16:47:50.130 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:50.130 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:47:50.130 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:47:50.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:47:50.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.281+0000 7f2b56d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.292+0000 7f2b56d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4701 4685 0.892635 0.90625 0.242301 0.139794 2024-09-16T16:47:50.311 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:50.311 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:50.311 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:50.311 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:50.311 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:50.311 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:50.312 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:50.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:50.316 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:50.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:47:50.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.430+0000 7f15e625c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.443+0000 7f15e625c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:50.467 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:50.468 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:50.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:47:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.581+0000 7f30438a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.592+0000 7f30438a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.684 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:50.684 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:50.684 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:50.684 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:50.684 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:50.684 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:50.684 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:50.685 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:50.685 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:50.685 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:50.685 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:50.685 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:50.688 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:50.688 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:50.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:47:50.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.809+0000 7fefb6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:50.820+0000 7fefb6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:47:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:47:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:47:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:47:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:47:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:47:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:47:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:47:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:47:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:47:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:47:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:47:50.926 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:47:50.926 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:47:51.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4797 4781 0.889237 0.75 0.0668466 0.140248 2024-09-16T16:47:51.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:51.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:51.681+0000 7f5485151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:51.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:51.690+0000 7f5485151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:52.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4906 4890 0.888359 0.851562 0.200028 0.14038 2024-09-16T16:47:53.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 16 5025 5009 0.889296 0.929688 0.139163 0.140261 2024-09-16T16:47:53.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:54.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:54.113+0000 7fcf5c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:54.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:54.120+0000 7fcf5c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:54.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 5128 5112 0.887414 0.804688 0.255631 0.140301 2024-09-16T16:47:55.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 5243 5227 0.887651 0.898438 0.193873 0.140651 2024-09-16T16:47:55.927 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:47:55.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:47:56.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:56.046+0000 7f279e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:56.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:56.060+0000 7f279e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:56.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 15 5349 5334 0.886549 0.835938 0.0432976 0.140753 2024-09-16T16:47:56.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:47:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:56.590+0000 7f198acc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:56.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:56.599+0000 7f198acc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:57.267 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:47:57.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:47:57.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 5459 5443 0.885819 0.851562 0.10897 0.140913 2024-09-16T16:47:57.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:57.427+0000 7f0c670a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:57.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:57.439+0000 7f0c670a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:58.274 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:47:58.299 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:47:58.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 5563 5547 0.884321 0.8125 0.225858 0.140974 2024-09-16T16:47:58.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:58.458+0000 7f6c1f893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:58.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:58.472+0000 7f6c1f893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:58.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:47:59.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:59.026+0000 7fa6ab391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:59.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:59.034+0000 7fa6ab391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:59.278 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:47:59.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:47:59.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 5693 5677 0.886945 1.01562 0.177983 0.140723 2024-09-16T16:47:59.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:59.444+0000 7fee2b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:47:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:47:59.458+0000 7fee2b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:00.283 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:48:00.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5802 5786 0.88625 0.851562 0.240119 0.140845 2024-09-16T16:48:00.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:48:00.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:00.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:00.439+0000 7fe09489c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:00.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:00.452+0000 7fe09489c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:00.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:00.676 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:00.692 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-16T16:48:00.376739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42648115,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5215,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5189,"ondisk_log_size":5189,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":260128,"kb_used_data":260128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208930784,"statfs":{"total":214211493888,"available":213945122816,"internally_reserved":0,"allocated":266371072,"data_stored":266371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000993"},"pg_stats":[{"pgid":"3.f","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.198145+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:53.198145+0000","last_peered":"2024-09-16T16:47:53.198145+0000","last_clean":"2024-09-16T16:47:53.198145+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:53.198145+0000","last_undegraded":"2024-09-16T16:47:53.198145+0000","last_fullsized":"2024-09-16T16:47:53.198145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'240","reported_seq":252,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.906567+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:53.906567+0000","last_peered":"2024-09-16T16:47:53.906567+0000","last_clean":"2024-09-16T16:47:53.906567+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:53.906567+0000","last_undegraded":"2024-09-16T16:47:53.906567+0000","last_fullsized":"2024-09-16T16:47:53.906567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'248","reported_seq":260,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.826627+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:52.826627+0000","last_peered":"2024-09-16T16:47:52.826627+0000","last_clean":"2024-09-16T16:47:52.826627+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:52.826627+0000","last_undegraded":"2024-09-16T16:47:52.826627+0000","last_fullsized":"2024-09-16T16:47:52.826627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.761319+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:52.761319+0000","last_peered":"2024-09-16T16:47:52.761319+0000","last_clean":"2024-09-16T16:47:52.761319+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:52.761319+0000","last_undegraded":"2024-09-16T16:47:52.761319+0000","last_fullsized":"2024-09-16T16:47:52.761319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.291614+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:54.291614+0000","last_peered":"2024-09-16T16:47:54.291614+0000","last_clean":"2024-09-16T16:47:54.291614+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:54.291614+0000","last_undegraded":"2024-09-16T16:47:54.291614+0000","last_fullsized":"2024-09-16T16:47:54.291614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'352","reported_seq":364,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:51.354972+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:51.354972+0000","last_peered":"2024-09-16T16:47:51.354972+0000","last_clean":"2024-09-16T16:47:51.354972+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:51.354972+0000","last_undegraded":"2024-09-16T16:47:51.354972+0000","last_fullsized":"2024-09-16T16:47:51.354972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.710690+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:53.710690+0000","last_peered":"2024-09-16T16:47:53.710690+0000","last_clean":"2024-09-16T16:47:53.710690+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:53.710690+0000","last_undegraded":"2024-09-16T16:47:53.710690+0000","last_fullsized":"2024-09-16T16:47:53.710690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'304","reported_seq":316,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.966535+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:53.966535+0000","last_peered":"2024-09-16T16:47:53.966535+0000","last_clean":"2024-09-16T16:47:53.966535+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:53.966535+0000","last_undegraded":"2024-09-16T16:47:53.966535+0000","last_fullsized":"2024-09-16T16:47:53.966535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'336","reported_seq":348,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.456948+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:53.456948+0000","last_peered":"2024-09-16T16:47:53.456948+0000","last_clean":"2024-09-16T16:47:53.456948+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:53.456948+0000","last_undegraded":"2024-09-16T16:47:53.456948+0000","last_fullsized":"2024-09-16T16:47:53.456948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'366","reported_seq":378,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.364333+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:54.364333+0000","last_peered":"2024-09-16T16:47:54.364333+0000","last_clean":"2024-09-16T16:47:54.364333+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:54.364333+0000","last_undegraded":"2024-09-16T16:47:54.364333+0000","last_fullsized":"2024-09-16T16:47:54.364333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2998272,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.855603+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:53.855603+0000","last_peered":"2024-09-16T16:47:53.855603+0000","last_clean":"2024-09-16T16:47:53.855603+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:53.855603+0000","last_undegraded":"2024-09-16T16:47:53.855603+0000","last_fullsized":"2024-09-16T16:47:53.855603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.021789+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:54.021789+0000","last_peered":"2024-09-16T16:47:54.021789+0000","last_clean":"2024-09-16T16:47:54.021789+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:54.021789+0000","last_undegraded":"2024-09-16T16:47:54.021789+0000","last_fullsized":"2024-09-16T16:47:54.021789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.514254+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:52.514254+0000","last_peered":"2024-09-16T16:47:52.514254+0000","last_clean":"2024-09-16T16:47:52.514254+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:52.514254+0000","last_undegraded":"2024-09-16T16:47:52.514254+0000","last_fullsized":"2024-09-16T16:47:52.514254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'296","reported_seq":308,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.525939+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:53.525939+0000","last_peered":"2024-09-16T16:47:53.525939+0000","last_clean":"2024-09-16T16:47:53.525939+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:53.525939+0000","last_undegraded":"2024-09-16T16:47:53.525939+0000","last_fullsized":"2024-09-16T16:47:53.525939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'400","reported_seq":412,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.652952+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:53.652952+0000","last_peered":"2024-09-16T16:47:53.652952+0000","last_clean":"2024-09-16T16:47:53.652952+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:53.652952+0000","last_undegraded":"2024-09-16T16:47:53.652952+0000","last_fullsized":"2024-09-16T16:47:53.652952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.068516+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:53.068516+0000","last_peered":"2024-09-16T16:47:53.068516+0000","last_clean":"2024-09-16T16:47:53.068516+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:53.068516+0000","last_undegraded":"2024-09-16T16:47:53.068516+0000","last_fullsized":"2024-09-16T16:47:53.068516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":42057728,"num_objects":642,"num_object_clones":0,"num_object_copies":1926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5134,"num_write_kb":41072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5134,"ondisk_log_size":5134,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74100,"kb_used_data":74100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223628,"statfs":{"total":53552873472,"available":53476995072,"internally_reserved":0,"allocated":75878400,"data_stored":75878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57988,"kb_used_data":57988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239740,"statfs":{"total":53552873472,"available":53493493760,"internally_reserved":0,"allocated":59379712,"data_stored":59379712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64720,"kb_used_data":64720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52233008,"statfs":{"total":53552873472,"available":53486600192,"internally_reserved":0,"allocated":66273280,"data_stored":66273280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63320,"kb_used_data":63320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234408,"statfs":{"total":53552873472,"available":53488033792,"internally_reserved":0,"allocated":64839680,"data_stored":64839680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:00.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:00.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:00.834+0000 7f205e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:00.846+0000 7f205e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.208 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:01.208 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:01.227 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-16T16:48:00.376739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42648115,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5215,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5189,"ondisk_log_size":5189,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":260128,"kb_used_data":260128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208930784,"statfs":{"total":214211493888,"available":213945122816,"internally_reserved":0,"allocated":266371072,"data_stored":266371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000993"},"pg_stats":[{"pgid":"3.f","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.198145+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:53.198145+0000","last_peered":"2024-09-16T16:47:53.198145+0000","last_clean":"2024-09-16T16:47:53.198145+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:53.198145+0000","last_undegraded":"2024-09-16T16:47:53.198145+0000","last_fullsized":"2024-09-16T16:47:53.198145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'240","reported_seq":252,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.906567+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:53.906567+0000","last_peered":"2024-09-16T16:47:53.906567+0000","last_clean":"2024-09-16T16:47:53.906567+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:53.906567+0000","last_undegraded":"2024-09-16T16:47:53.906567+0000","last_fullsized":"2024-09-16T16:47:53.906567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'248","reported_seq":260,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.826627+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:52.826627+0000","last_peered":"2024-09-16T16:47:52.826627+0000","last_clean":"2024-09-16T16:47:52.826627+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:52.826627+0000","last_undegraded":"2024-09-16T16:47:52.826627+0000","last_fullsized":"2024-09-16T16:47:52.826627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.761319+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:52.761319+0000","last_peered":"2024-09-16T16:47:52.761319+0000","last_clean":"2024-09-16T16:47:52.761319+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:52.761319+0000","last_undegraded":"2024-09-16T16:47:52.761319+0000","last_fullsized":"2024-09-16T16:47:52.761319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.291614+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:54.291614+0000","last_peered":"2024-09-16T16:47:54.291614+0000","last_clean":"2024-09-16T16:47:54.291614+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:54.291614+0000","last_undegraded":"2024-09-16T16:47:54.291614+0000","last_fullsized":"2024-09-16T16:47:54.291614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'352","reported_seq":364,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:51.354972+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:51.354972+0000","last_peered":"2024-09-16T16:47:51.354972+0000","last_clean":"2024-09-16T16:47:51.354972+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:51.354972+0000","last_undegraded":"2024-09-16T16:47:51.354972+0000","last_fullsized":"2024-09-16T16:47:51.354972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.710690+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:53.710690+0000","last_peered":"2024-09-16T16:47:53.710690+0000","last_clean":"2024-09-16T16:47:53.710690+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:53.710690+0000","last_undegraded":"2024-09-16T16:47:53.710690+0000","last_fullsized":"2024-09-16T16:47:53.710690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'304","reported_seq":316,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.966535+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:53.966535+0000","last_peered":"2024-09-16T16:47:53.966535+0000","last_clean":"2024-09-16T16:47:53.966535+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:53.966535+0000","last_undegraded":"2024-09-16T16:47:53.966535+0000","last_fullsized":"2024-09-16T16:47:53.966535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'336","reported_seq":348,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.456948+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:53.456948+0000","last_peered":"2024-09-16T16:47:53.456948+0000","last_clean":"2024-09-16T16:47:53.456948+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:53.456948+0000","last_undegraded":"2024-09-16T16:47:53.456948+0000","last_fullsized":"2024-09-16T16:47:53.456948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'366","reported_seq":378,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.364333+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:54.364333+0000","last_peered":"2024-09-16T16:47:54.364333+0000","last_clean":"2024-09-16T16:47:54.364333+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:54.364333+0000","last_undegraded":"2024-09-16T16:47:54.364333+0000","last_fullsized":"2024-09-16T16:47:54.364333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2998272,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.855603+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:53.855603+0000","last_peered":"2024-09-16T16:47:53.855603+0000","last_clean":"2024-09-16T16:47:53.855603+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:53.855603+0000","last_undegraded":"2024-09-16T16:47:53.855603+0000","last_fullsized":"2024-09-16T16:47:53.855603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.021789+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:54.021789+0000","last_peered":"2024-09-16T16:47:54.021789+0000","last_clean":"2024-09-16T16:47:54.021789+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:54.021789+0000","last_undegraded":"2024-09-16T16:47:54.021789+0000","last_fullsized":"2024-09-16T16:47:54.021789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.514254+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:52.514254+0000","last_peered":"2024-09-16T16:47:52.514254+0000","last_clean":"2024-09-16T16:47:52.514254+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:52.514254+0000","last_undegraded":"2024-09-16T16:47:52.514254+0000","last_fullsized":"2024-09-16T16:47:52.514254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'296","reported_seq":308,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.525939+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:53.525939+0000","last_peered":"2024-09-16T16:47:53.525939+0000","last_clean":"2024-09-16T16:47:53.525939+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:53.525939+0000","last_undegraded":"2024-09-16T16:47:53.525939+0000","last_fullsized":"2024-09-16T16:47:53.525939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'400","reported_seq":412,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.652952+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:53.652952+0000","last_peered":"2024-09-16T16:47:53.652952+0000","last_clean":"2024-09-16T16:47:53.652952+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:53.652952+0000","last_undegraded":"2024-09-16T16:47:53.652952+0000","last_fullsized":"2024-09-16T16:47:53.652952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.068516+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:53.068516+0000","last_peered":"2024-09-16T16:47:53.068516+0000","last_clean":"2024-09-16T16:47:53.068516+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:53.068516+0000","last_undegraded":"2024-09-16T16:47:53.068516+0000","last_fullsized":"2024-09-16T16:47:53.068516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":42057728,"num_objects":642,"num_object_clones":0,"num_object_copies":1926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5134,"num_write_kb":41072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5134,"ondisk_log_size":5134,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74100,"kb_used_data":74100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223628,"statfs":{"total":53552873472,"available":53476995072,"internally_reserved":0,"allocated":75878400,"data_stored":75878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57988,"kb_used_data":57988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239740,"statfs":{"total":53552873472,"available":53493493760,"internally_reserved":0,"allocated":59379712,"data_stored":59379712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64720,"kb_used_data":64720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52233008,"statfs":{"total":53552873472,"available":53486600192,"internally_reserved":0,"allocated":66273280,"data_stored":66273280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63320,"kb_used_data":63320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234408,"statfs":{"total":53552873472,"available":53488033792,"internally_reserved":0,"allocated":64839680,"data_stored":64839680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:01.228 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:48:01.228 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:01.228 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:01.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:01.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 16 5914 5898 0.886032 0.875 0.116215 0.140934 2024-09-16T16:48:01.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.349+0000 7f2335911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.362+0000 7f2335911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:01.382 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:01.383 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:01.387 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:01.387 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:01.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:01.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.520+0000 7fc98d711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.529+0000 7fc98d711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.537+0000 7f3891d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.553+0000 7f3891d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.591 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:01.591 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:01.591 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:01.591 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:01.591 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:01.592 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:01.596 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:01.596 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:01.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.720+0000 7f6b22f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.731+0000 7f6b22f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:01.775 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:01.775 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:01.777 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:01.777 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:01.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:01.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.903+0000 7f394d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:01.916+0000 7f394d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:01.949 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:01.950 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:01.953 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:01.953 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:02.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 6023 6007 0.88538 0.851562 0.188929 0.140974 2024-09-16T16:48:03.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 6134 6118 0.885042 0.867188 0.14265 0.141041 2024-09-16T16:48:03.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:04.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:04.064+0000 7f4561711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:04.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:04.071+0000 7f4561711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:04.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 6242 6226 0.88429 0.84375 0.293578 0.141066 2024-09-16T16:48:05.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 6359 6343 0.88482 0.914062 0.147328 0.141068 2024-09-16T16:48:06.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:06.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 6466 6450 0.883961 0.835938 0.17921 0.141294 2024-09-16T16:48:06.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:06.376+0000 7f7f97f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:06.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:06.384+0000 7f7f97f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:06.954 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:06.954 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:06.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:07.079+0000 7fe121191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:07.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:07.090+0000 7fe121191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:07.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 6578 6562 0.883805 0.875 0.138693 0.141257 2024-09-16T16:48:07.378 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:07.379 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:07.402 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-16T16:48:06.377752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42648115,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5215,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5189,"ondisk_log_size":5189,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":260128,"kb_used_data":260128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208930784,"statfs":{"total":214211493888,"available":213945122816,"internally_reserved":0,"allocated":266371072,"data_stored":266371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001457"},"pg_stats":[{"pgid":"3.f","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.198145+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:53.198145+0000","last_peered":"2024-09-16T16:47:53.198145+0000","last_clean":"2024-09-16T16:47:53.198145+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:53.198145+0000","last_undegraded":"2024-09-16T16:47:53.198145+0000","last_fullsized":"2024-09-16T16:47:53.198145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'240","reported_seq":252,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.906567+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:53.906567+0000","last_peered":"2024-09-16T16:47:53.906567+0000","last_clean":"2024-09-16T16:47:53.906567+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:53.906567+0000","last_undegraded":"2024-09-16T16:47:53.906567+0000","last_fullsized":"2024-09-16T16:47:53.906567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'248","reported_seq":260,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.826627+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:52.826627+0000","last_peered":"2024-09-16T16:47:52.826627+0000","last_clean":"2024-09-16T16:47:52.826627+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:52.826627+0000","last_undegraded":"2024-09-16T16:47:52.826627+0000","last_fullsized":"2024-09-16T16:47:52.826627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.761319+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:52.761319+0000","last_peered":"2024-09-16T16:47:52.761319+0000","last_clean":"2024-09-16T16:47:52.761319+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:52.761319+0000","last_undegraded":"2024-09-16T16:47:52.761319+0000","last_fullsized":"2024-09-16T16:47:52.761319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.291614+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:54.291614+0000","last_peered":"2024-09-16T16:47:54.291614+0000","last_clean":"2024-09-16T16:47:54.291614+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:54.291614+0000","last_undegraded":"2024-09-16T16:47:54.291614+0000","last_fullsized":"2024-09-16T16:47:54.291614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'352","reported_seq":364,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:51.354972+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:51.354972+0000","last_peered":"2024-09-16T16:47:51.354972+0000","last_clean":"2024-09-16T16:47:51.354972+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:51.354972+0000","last_undegraded":"2024-09-16T16:47:51.354972+0000","last_fullsized":"2024-09-16T16:47:51.354972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.710690+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:53.710690+0000","last_peered":"2024-09-16T16:47:53.710690+0000","last_clean":"2024-09-16T16:47:53.710690+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:53.710690+0000","last_undegraded":"2024-09-16T16:47:53.710690+0000","last_fullsized":"2024-09-16T16:47:53.710690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'304","reported_seq":316,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.966535+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:53.966535+0000","last_peered":"2024-09-16T16:47:53.966535+0000","last_clean":"2024-09-16T16:47:53.966535+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:53.966535+0000","last_undegraded":"2024-09-16T16:47:53.966535+0000","last_fullsized":"2024-09-16T16:47:53.966535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'336","reported_seq":348,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.456948+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:53.456948+0000","last_peered":"2024-09-16T16:47:53.456948+0000","last_clean":"2024-09-16T16:47:53.456948+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:53.456948+0000","last_undegraded":"2024-09-16T16:47:53.456948+0000","last_fullsized":"2024-09-16T16:47:53.456948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'366","reported_seq":378,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.364333+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:54.364333+0000","last_peered":"2024-09-16T16:47:54.364333+0000","last_clean":"2024-09-16T16:47:54.364333+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:54.364333+0000","last_undegraded":"2024-09-16T16:47:54.364333+0000","last_fullsized":"2024-09-16T16:47:54.364333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2998272,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.855603+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:53.855603+0000","last_peered":"2024-09-16T16:47:53.855603+0000","last_clean":"2024-09-16T16:47:53.855603+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:53.855603+0000","last_undegraded":"2024-09-16T16:47:53.855603+0000","last_fullsized":"2024-09-16T16:47:53.855603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.021789+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:54.021789+0000","last_peered":"2024-09-16T16:47:54.021789+0000","last_clean":"2024-09-16T16:47:54.021789+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:54.021789+0000","last_undegraded":"2024-09-16T16:47:54.021789+0000","last_fullsized":"2024-09-16T16:47:54.021789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.514254+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:52.514254+0000","last_peered":"2024-09-16T16:47:52.514254+0000","last_clean":"2024-09-16T16:47:52.514254+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:52.514254+0000","last_undegraded":"2024-09-16T16:47:52.514254+0000","last_fullsized":"2024-09-16T16:47:52.514254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'296","reported_seq":308,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.525939+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:53.525939+0000","last_peered":"2024-09-16T16:47:53.525939+0000","last_clean":"2024-09-16T16:47:53.525939+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:53.525939+0000","last_undegraded":"2024-09-16T16:47:53.525939+0000","last_fullsized":"2024-09-16T16:47:53.525939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'400","reported_seq":412,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.652952+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:53.652952+0000","last_peered":"2024-09-16T16:47:53.652952+0000","last_clean":"2024-09-16T16:47:53.652952+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:53.652952+0000","last_undegraded":"2024-09-16T16:47:53.652952+0000","last_fullsized":"2024-09-16T16:47:53.652952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.068516+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:53.068516+0000","last_peered":"2024-09-16T16:47:53.068516+0000","last_clean":"2024-09-16T16:47:53.068516+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:53.068516+0000","last_undegraded":"2024-09-16T16:47:53.068516+0000","last_fullsized":"2024-09-16T16:47:53.068516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":42057728,"num_objects":642,"num_object_clones":0,"num_object_copies":1926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5134,"num_write_kb":41072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5134,"ondisk_log_size":5134,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74100,"kb_used_data":74100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223628,"statfs":{"total":53552873472,"available":53476995072,"internally_reserved":0,"allocated":75878400,"data_stored":75878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57988,"kb_used_data":57988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239740,"statfs":{"total":53552873472,"available":53493493760,"internally_reserved":0,"allocated":59379712,"data_stored":59379712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64720,"kb_used_data":64720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52233008,"statfs":{"total":53552873472,"available":53486600192,"internally_reserved":0,"allocated":66273280,"data_stored":66273280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63320,"kb_used_data":63320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234408,"statfs":{"total":53552873472,"available":53488033792,"internally_reserved":0,"allocated":64839680,"data_stored":64839680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:08.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 6681 6665 0.882463 0.804688 0.271324 0.141437 2024-09-16T16:48:08.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:08.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:08.825+0000 7fe079d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:08.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:08.833+0000 7fe079d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:09.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:48:09.301861+0000 min lat: 0.0185597 max lat: 0.637425 avg lat: 0.141741 2024-09-16T16:48:09.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:48:09.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 6777 6761 0.880254 0.75 0.0681303 0.141741 2024-09-16T16:48:10.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 6895 6879 0.880935 0.921875 0.159803 0.141653 2024-09-16T16:48:11.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:11.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6990 6974 0.878696 0.742188 0.152757 0.141984 2024-09-16T16:48:11.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:11.344+0000 7f8a82191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:11.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:11.352+0000 7f8a82191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 7085 7069 0.876528 0.742188 0.131302 0.142445 2024-09-16T16:48:12.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:12.404 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:12.404 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:12.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:12.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:12.536+0000 7f706f25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:12.548+0000 7f706f25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.634 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:12.634 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:12.634 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:12.634 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:12.637 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:12.638 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:12.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:12.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:12.756+0000 7fe46c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:12.769+0000 7fe46c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.795 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:12.796 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:12.799 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:12.800 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:12.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:12.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:12.922+0000 7fedaf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:12.935+0000 7fedaf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:12.960 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:12.960 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:12.960 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:12.960 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:12.960 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:12.961 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:12.961 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:12.961 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:12.961 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:12.961 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:12.961 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:12.961 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:12.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:12.965 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:12.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:13.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:13.097+0000 7f2cdf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:13.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:13.108+0000 7f2cdf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:13.190 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:13.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:13.193 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:13.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 16 7176 7160 0.873939 0.710938 0.218642 0.142838 2024-09-16T16:48:13.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:13.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:13.822+0000 7f86a8288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:13.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:13.831+0000 7f86a8288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:14.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 7283 7267 0.873353 0.835938 0.16699 0.142963 2024-09-16T16:48:15.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 7389 7373 0.872667 0.828125 0.0746146 0.142958 2024-09-16T16:48:16.294 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:16.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 7482 7466 0.870485 0.726562 0.375212 0.143188 2024-09-16T16:48:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:16.416+0000 7f9fc284f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:16.423+0000 7f9fc284f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:17.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 7578 7562 0.868712 0.75 0.173869 0.143745 2024-09-16T16:48:18.194 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:18.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:18.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:18.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 16 7683 7667 0.868009 0.820312 0.139092 0.143866 2024-09-16T16:48:18.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:18.359+0000 7f7f84f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:18.372+0000 7f7f84f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:18.726 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:18.727 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:18.742 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-16T16:48:18.380243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42648115,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5215,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5189,"ondisk_log_size":5189,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":260128,"kb_used_data":260128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208930784,"statfs":{"total":214211493888,"available":213945122816,"internally_reserved":0,"allocated":266371072,"data_stored":266371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002491"},"pg_stats":[{"pgid":"3.f","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.198145+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:53.198145+0000","last_peered":"2024-09-16T16:47:53.198145+0000","last_clean":"2024-09-16T16:47:53.198145+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:53.198145+0000","last_undegraded":"2024-09-16T16:47:53.198145+0000","last_fullsized":"2024-09-16T16:47:53.198145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'240","reported_seq":252,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.906567+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:53.906567+0000","last_peered":"2024-09-16T16:47:53.906567+0000","last_clean":"2024-09-16T16:47:53.906567+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:53.906567+0000","last_undegraded":"2024-09-16T16:47:53.906567+0000","last_fullsized":"2024-09-16T16:47:53.906567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'248","reported_seq":260,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.826627+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:52.826627+0000","last_peered":"2024-09-16T16:47:52.826627+0000","last_clean":"2024-09-16T16:47:52.826627+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:52.826627+0000","last_undegraded":"2024-09-16T16:47:52.826627+0000","last_fullsized":"2024-09-16T16:47:52.826627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.761319+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:52.761319+0000","last_peered":"2024-09-16T16:47:52.761319+0000","last_clean":"2024-09-16T16:47:52.761319+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:52.761319+0000","last_undegraded":"2024-09-16T16:47:52.761319+0000","last_fullsized":"2024-09-16T16:47:52.761319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.291614+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:54.291614+0000","last_peered":"2024-09-16T16:47:54.291614+0000","last_clean":"2024-09-16T16:47:54.291614+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:54.291614+0000","last_undegraded":"2024-09-16T16:47:54.291614+0000","last_fullsized":"2024-09-16T16:47:54.291614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'352","reported_seq":364,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:51.354972+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:51.354972+0000","last_peered":"2024-09-16T16:47:51.354972+0000","last_clean":"2024-09-16T16:47:51.354972+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:51.354972+0000","last_undegraded":"2024-09-16T16:47:51.354972+0000","last_fullsized":"2024-09-16T16:47:51.354972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.710690+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:53.710690+0000","last_peered":"2024-09-16T16:47:53.710690+0000","last_clean":"2024-09-16T16:47:53.710690+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:53.710690+0000","last_undegraded":"2024-09-16T16:47:53.710690+0000","last_fullsized":"2024-09-16T16:47:53.710690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'304","reported_seq":316,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.966535+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:53.966535+0000","last_peered":"2024-09-16T16:47:53.966535+0000","last_clean":"2024-09-16T16:47:53.966535+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:53.966535+0000","last_undegraded":"2024-09-16T16:47:53.966535+0000","last_fullsized":"2024-09-16T16:47:53.966535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'336","reported_seq":348,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.456948+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:53.456948+0000","last_peered":"2024-09-16T16:47:53.456948+0000","last_clean":"2024-09-16T16:47:53.456948+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:53.456948+0000","last_undegraded":"2024-09-16T16:47:53.456948+0000","last_fullsized":"2024-09-16T16:47:53.456948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'366","reported_seq":378,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.364333+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:54.364333+0000","last_peered":"2024-09-16T16:47:54.364333+0000","last_clean":"2024-09-16T16:47:54.364333+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:54.364333+0000","last_undegraded":"2024-09-16T16:47:54.364333+0000","last_fullsized":"2024-09-16T16:47:54.364333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2998272,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.855603+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:53.855603+0000","last_peered":"2024-09-16T16:47:53.855603+0000","last_clean":"2024-09-16T16:47:53.855603+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:53.855603+0000","last_undegraded":"2024-09-16T16:47:53.855603+0000","last_fullsized":"2024-09-16T16:47:53.855603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.021789+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:54.021789+0000","last_peered":"2024-09-16T16:47:54.021789+0000","last_clean":"2024-09-16T16:47:54.021789+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:54.021789+0000","last_undegraded":"2024-09-16T16:47:54.021789+0000","last_fullsized":"2024-09-16T16:47:54.021789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.514254+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:52.514254+0000","last_peered":"2024-09-16T16:47:52.514254+0000","last_clean":"2024-09-16T16:47:52.514254+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:52.514254+0000","last_undegraded":"2024-09-16T16:47:52.514254+0000","last_fullsized":"2024-09-16T16:47:52.514254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'296","reported_seq":308,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.525939+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:53.525939+0000","last_peered":"2024-09-16T16:47:53.525939+0000","last_clean":"2024-09-16T16:47:53.525939+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:53.525939+0000","last_undegraded":"2024-09-16T16:47:53.525939+0000","last_fullsized":"2024-09-16T16:47:53.525939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'400","reported_seq":412,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.652952+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:53.652952+0000","last_peered":"2024-09-16T16:47:53.652952+0000","last_clean":"2024-09-16T16:47:53.652952+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:53.652952+0000","last_undegraded":"2024-09-16T16:47:53.652952+0000","last_fullsized":"2024-09-16T16:47:53.652952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.068516+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:53.068516+0000","last_peered":"2024-09-16T16:47:53.068516+0000","last_clean":"2024-09-16T16:47:53.068516+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:53.068516+0000","last_undegraded":"2024-09-16T16:47:53.068516+0000","last_fullsized":"2024-09-16T16:47:53.068516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":42057728,"num_objects":642,"num_object_clones":0,"num_object_copies":1926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5134,"num_write_kb":41072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5134,"ondisk_log_size":5134,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74100,"kb_used_data":74100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223628,"statfs":{"total":53552873472,"available":53476995072,"internally_reserved":0,"allocated":75878400,"data_stored":75878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57988,"kb_used_data":57988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239740,"statfs":{"total":53552873472,"available":53493493760,"internally_reserved":0,"allocated":59379712,"data_stored":59379712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64720,"kb_used_data":64720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52233008,"statfs":{"total":53552873472,"available":53486600192,"internally_reserved":0,"allocated":66273280,"data_stored":66273280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63320,"kb_used_data":63320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234408,"statfs":{"total":53552873472,"available":53488033792,"internally_reserved":0,"allocated":64839680,"data_stored":64839680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:18.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:18.768+0000 7f75bcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:18.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:18.776+0000 7f75bcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:19.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 7781 7765 0.866545 0.765625 0.156025 0.143858 2024-09-16T16:48:20.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 7872 7856 0.864353 0.710938 0.191455 0.144298 2024-09-16T16:48:21.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:21.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:21.264+0000 7f07b8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:21.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:21.271+0000 7f07b8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:21.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7960 7944 0.861895 0.6875 0.0636346 0.144801 2024-09-16T16:48:22.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 8068 8052 0.861646 0.84375 0.111132 0.144946 2024-09-16T16:48:23.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 8161 8145 0.859819 0.726562 0.388877 0.144945 2024-09-16T16:48:23.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:23.663+0000 7f93dbcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:23.671+0000 7f93dbcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.745 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:23.745 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:23.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:23.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:23.882+0000 7f215365a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:23.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:23.894+0000 7f215365a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:24.200 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:24.200 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:24.216 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-16T16:48:22.380966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42648115,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5215,"num_write_kb":42180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5189,"ondisk_log_size":5189,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":260128,"kb_used_data":260128,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208930784,"statfs":{"total":214211493888,"available":213945122816,"internally_reserved":0,"allocated":266371072,"data_stored":266371072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002424"},"pg_stats":[{"pgid":"3.f","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.198145+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:47:53.198145+0000","last_peered":"2024-09-16T16:47:53.198145+0000","last_clean":"2024-09-16T16:47:53.198145+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:47:53.198145+0000","last_undegraded":"2024-09-16T16:47:53.198145+0000","last_fullsized":"2024-09-16T16:47:53.198145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"20'240","reported_seq":252,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.906567+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:47:53.906567+0000","last_peered":"2024-09-16T16:47:53.906567+0000","last_clean":"2024-09-16T16:47:53.906567+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:47:53.906567+0000","last_undegraded":"2024-09-16T16:47:53.906567+0000","last_fullsized":"2024-09-16T16:47:53.906567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'248","reported_seq":260,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.826627+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:47:52.826627+0000","last_peered":"2024-09-16T16:47:52.826627+0000","last_clean":"2024-09-16T16:47:52.826627+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:47:52.826627+0000","last_undegraded":"2024-09-16T16:47:52.826627+0000","last_fullsized":"2024-09-16T16:47:52.826627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.761319+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:47:52.761319+0000","last_peered":"2024-09-16T16:47:52.761319+0000","last_clean":"2024-09-16T16:47:52.761319+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:47:52.761319+0000","last_undegraded":"2024-09-16T16:47:52.761319+0000","last_fullsized":"2024-09-16T16:47:52.761319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'328","reported_seq":340,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.291614+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:47:54.291614+0000","last_peered":"2024-09-16T16:47:54.291614+0000","last_clean":"2024-09-16T16:47:54.291614+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:47:54.291614+0000","last_undegraded":"2024-09-16T16:47:54.291614+0000","last_fullsized":"2024-09-16T16:47:54.291614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"20'352","reported_seq":364,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:51.354972+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:47:51.354972+0000","last_peered":"2024-09-16T16:47:51.354972+0000","last_clean":"2024-09-16T16:47:51.354972+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:47:51.354972+0000","last_undegraded":"2024-09-16T16:47:51.354972+0000","last_fullsized":"2024-09-16T16:47:51.354972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"20'376","reported_seq":388,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.710690+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:47:53.710690+0000","last_peered":"2024-09-16T16:47:53.710690+0000","last_clean":"2024-09-16T16:47:53.710690+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:47:53.710690+0000","last_undegraded":"2024-09-16T16:47:53.710690+0000","last_fullsized":"2024-09-16T16:47:53.710690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"20'304","reported_seq":316,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.966535+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:47:53.966535+0000","last_peered":"2024-09-16T16:47:53.966535+0000","last_clean":"2024-09-16T16:47:53.966535+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:47:53.966535+0000","last_undegraded":"2024-09-16T16:47:53.966535+0000","last_fullsized":"2024-09-16T16:47:53.966535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.229789+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:47:09.229789+0000","last_peered":"2024-09-16T16:47:09.229789+0000","last_clean":"2024-09-16T16:47:09.229789+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:47:09.229789+0000","last_undegraded":"2024-09-16T16:47:09.229789+0000","last_fullsized":"2024-09-16T16:47:09.229789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237442+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:47:09.237442+0000","last_peered":"2024-09-16T16:47:09.237442+0000","last_clean":"2024-09-16T16:47:09.237442+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:47:09.237442+0000","last_undegraded":"2024-09-16T16:47:09.237442+0000","last_fullsized":"2024-09-16T16:47:09.237442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"20'336","reported_seq":348,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.456948+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:47:53.456948+0000","last_peered":"2024-09-16T16:47:53.456948+0000","last_clean":"2024-09-16T16:47:53.456948+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:47:53.456948+0000","last_undegraded":"2024-09-16T16:47:53.456948+0000","last_fullsized":"2024-09-16T16:47:53.456948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.239136+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:47:09.239136+0000","last_peered":"2024-09-16T16:47:09.239136+0000","last_clean":"2024-09-16T16:47:09.239136+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:47:09.239136+0000","last_undegraded":"2024-09-16T16:47:09.239136+0000","last_fullsized":"2024-09-16T16:47:09.239136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"20'366","reported_seq":378,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.364333+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:47:54.364333+0000","last_peered":"2024-09-16T16:47:54.364333+0000","last_clean":"2024-09-16T16:47:54.364333+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:47:54.364333+0000","last_undegraded":"2024-09-16T16:47:54.364333+0000","last_fullsized":"2024-09-16T16:47:54.364333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2998272,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":2928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.228935+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:47:09.228935+0000","last_peered":"2024-09-16T16:47:09.228935+0000","last_clean":"2024-09-16T16:47:09.228935+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:47:09.228935+0000","last_undegraded":"2024-09-16T16:47:09.228935+0000","last_fullsized":"2024-09-16T16:47:09.228935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.855603+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:47:53.855603+0000","last_peered":"2024-09-16T16:47:53.855603+0000","last_clean":"2024-09-16T16:47:53.855603+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:47:53.855603+0000","last_undegraded":"2024-09-16T16:47:53.855603+0000","last_fullsized":"2024-09-16T16:47:53.855603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.230723+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:47:09.230723+0000","last_peered":"2024-09-16T16:47:09.230723+0000","last_clean":"2024-09-16T16:47:09.230723+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:47:09.230723+0000","last_undegraded":"2024-09-16T16:47:09.230723+0000","last_fullsized":"2024-09-16T16:47:09.230723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:54.021789+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:47:54.021789+0000","last_peered":"2024-09-16T16:47:54.021789+0000","last_clean":"2024-09-16T16:47:54.021789+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:47:54.021789+0000","last_undegraded":"2024-09-16T16:47:54.021789+0000","last_fullsized":"2024-09-16T16:47:54.021789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"20'320","reported_seq":332,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:52.514254+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:47:52.514254+0000","last_peered":"2024-09-16T16:47:52.514254+0000","last_clean":"2024-09-16T16:47:52.514254+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:47:52.514254+0000","last_undegraded":"2024-09-16T16:47:52.514254+0000","last_fullsized":"2024-09-16T16:47:52.514254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235936+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:47:09.235936+0000","last_peered":"2024-09-16T16:47:09.235936+0000","last_clean":"2024-09-16T16:47:09.235936+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:47:09.235936+0000","last_undegraded":"2024-09-16T16:47:09.235936+0000","last_fullsized":"2024-09-16T16:47:09.235936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"20'296","reported_seq":308,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.525939+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:47:53.525939+0000","last_peered":"2024-09-16T16:47:53.525939+0000","last_clean":"2024-09-16T16:47:53.525939+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:47:53.525939+0000","last_undegraded":"2024-09-16T16:47:53.525939+0000","last_fullsized":"2024-09-16T16:47:53.525939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.235355+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:47:09.235355+0000","last_peered":"2024-09-16T16:47:09.235355+0000","last_clean":"2024-09-16T16:47:09.235355+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:47:09.235355+0000","last_undegraded":"2024-09-16T16:47:09.235355+0000","last_fullsized":"2024-09-16T16:47:09.235355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"20'400","reported_seq":412,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.652952+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:47:53.652952+0000","last_peered":"2024-09-16T16:47:53.652952+0000","last_clean":"2024-09-16T16:47:53.652952+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:47:53.652952+0000","last_undegraded":"2024-09-16T16:47:53.652952+0000","last_fullsized":"2024-09-16T16:47:53.652952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.237351+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:47:09.237351+0000","last_peered":"2024-09-16T16:47:09.237351+0000","last_clean":"2024-09-16T16:47:09.237351+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:47:09.237351+0000","last_undegraded":"2024-09-16T16:47:09.237351+0000","last_fullsized":"2024-09-16T16:47:09.237351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"20'272","reported_seq":284,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:53.068516+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:47:53.068516+0000","last_peered":"2024-09-16T16:47:53.068516+0000","last_clean":"2024-09-16T16:47:53.068516+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:47:53.068516+0000","last_undegraded":"2024-09-16T16:47:53.068516+0000","last_fullsized":"2024-09-16T16:47:53.068516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T16:47:09.238153+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:47:09.238153+0000","last_peered":"2024-09-16T16:47:09.238153+0000","last_clean":"2024-09-16T16:47:09.238153+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:47:09.238153+0000","last_undegraded":"2024-09-16T16:47:09.238153+0000","last_fullsized":"2024-09-16T16:47:09.238153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":42057728,"num_objects":642,"num_object_clones":0,"num_object_copies":1926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5134,"num_write_kb":41072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5134,"ondisk_log_size":5134,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213944545280,"internally_reserved":0,"allocated":266948608,"data_stored":266948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74100,"kb_used_data":74100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223628,"statfs":{"total":53552873472,"available":53476995072,"internally_reserved":0,"allocated":75878400,"data_stored":75878400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57988,"kb_used_data":57988,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52239740,"statfs":{"total":53552873472,"available":53493493760,"internally_reserved":0,"allocated":59379712,"data_stored":59379712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64720,"kb_used_data":64720,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52233008,"statfs":{"total":53552873472,"available":53486600192,"internally_reserved":0,"allocated":66273280,"data_stored":66273280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63320,"kb_used_data":63320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234408,"statfs":{"total":53552873472,"available":53488033792,"internally_reserved":0,"allocated":64839680,"data_stored":64839680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53487902720,"internally_reserved":0,"allocated":64970752,"data_stored":64970752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53486501888,"internally_reserved":0,"allocated":66371584,"data_stored":66371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53493370880,"internally_reserved":0,"allocated":59502592,"data_stored":59502592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53476769792,"internally_reserved":0,"allocated":76103680,"data_stored":76103680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:24.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 8248 8232 0.857417 0.679688 0.326813 0.145399 2024-09-16T16:48:25.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 8369 8353 0.858572 0.945312 0.0890772 0.145479 2024-09-16T16:48:25.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:25.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:25.985+0000 7f49deb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:25.993+0000 7f49deb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:26.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 8462 8446 0.856856 0.726562 0.10077 0.145632 2024-09-16T16:48:27.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 8564 8548 0.856086 0.796875 0.243229 0.145741 2024-09-16T16:48:28.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:28.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 8670 8654 0.855732 0.828125 0.216902 0.145898 2024-09-16T16:48:28.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:28.435+0000 7fedd8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:28.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:28.445+0000 7fedd8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.218 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:29.219 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:29.219 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:29.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:29.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:48:29.303829+0000 min lat: 0.0185597 max lat: 0.678722 avg lat: 0.145975 2024-09-16T16:48:29.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:48:29.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 8770 8754 0.8548 0.78125 0.160342 0.145975 2024-09-16T16:48:29.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.345+0000 7f2bdd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.359+0000 7f2bdd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.387 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:29.387 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:29.388 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:29.393 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:29.393 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:29.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.523+0000 7fb73fad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.537+0000 7fb73fad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.560 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:29.564 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:29.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:29.565 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:29.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.683+0000 7f12e9274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.695+0000 7f12e9274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:29.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:29.716 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:29.718 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:29.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:29.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.835+0000 7f64576fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:29.846+0000 7f64576fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:29.864 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:29.865 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:29.868 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:29.868 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:30.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 8856 8840 0.852541 0.671875 0.20296 0.14643 2024-09-16T16:48:30.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:30.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:30.815+0000 7f11a6ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:30.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:30.822+0000 7f11a6ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:31.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 16 8964 8948 0.852433 0.84375 0.0867458 0.146457 2024-09-16T16:48:32.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 9051 9035 0.850351 0.679688 0.151105 0.146788 2024-09-16T16:48:33.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:33.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 9140 9124 0.848504 0.695312 0.472334 0.146938 2024-09-16T16:48:33.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:33.313+0000 7f0977951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:33.322+0000 7f0977951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:34.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 9242 9226 0.847896 0.796875 0.190754 0.147197 2024-09-16T16:48:34.869 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:34.869 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:34.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:34.989+0000 7fcfb4e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:34.999+0000 7fcfb4e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:35.212 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:35.212 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:35.228 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-16T16:48:34.383400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68215347,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8336,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8310,"ondisk_log_size":8310,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":416532,"kb_used_data":416532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208774380,"statfs":{"total":214211493888,"available":213784965120,"internally_reserved":0,"allocated":426528768,"data_stored":426528768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25567232,"num_objects":390,"num_object_clones":0,"num_object_copies":1170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3121,"num_write_kb":24968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002433"},"pg_stats":[{"pgid":"3.f","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.281599+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:48:24.281599+0000","last_peered":"2024-09-16T16:48:24.281599+0000","last_clean":"2024-09-16T16:48:24.281599+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:48:24.281599+0000","last_undegraded":"2024-09-16T16:48:24.281599+0000","last_fullsized":"2024-09-16T16:48:24.281599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'384","reported_seq":408,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.465764+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:48:22.465764+0000","last_peered":"2024-09-16T16:48:22.465764+0000","last_clean":"2024-09-16T16:48:22.465764+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:48:22.465764+0000","last_undegraded":"2024-09-16T16:48:22.465764+0000","last_fullsized":"2024-09-16T16:48:22.465764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'480","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.562624+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:48:21.562624+0000","last_peered":"2024-09-16T16:48:21.562624+0000","last_clean":"2024-09-16T16:48:21.562624+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:48:21.562624+0000","last_undegraded":"2024-09-16T16:48:21.562624+0000","last_fullsized":"2024-09-16T16:48:21.562624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.012021+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:48:24.012021+0000","last_peered":"2024-09-16T16:48:24.012021+0000","last_clean":"2024-09-16T16:48:24.012021+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:48:24.012021+0000","last_undegraded":"2024-09-16T16:48:24.012021+0000","last_fullsized":"2024-09-16T16:48:24.012021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'472","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.802980+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:48:19.802980+0000","last_peered":"2024-09-16T16:48:19.802980+0000","last_clean":"2024-09-16T16:48:19.802980+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:48:19.802980+0000","last_undegraded":"2024-09-16T16:48:19.802980+0000","last_fullsized":"2024-09-16T16:48:19.802980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'600","reported_seq":624,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.862520+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:48:22.862520+0000","last_peered":"2024-09-16T16:48:22.862520+0000","last_clean":"2024-09-16T16:48:22.862520+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:48:22.862520+0000","last_undegraded":"2024-09-16T16:48:22.862520+0000","last_fullsized":"2024-09-16T16:48:22.862520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'528","reported_seq":552,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.103145+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:48:24.103145+0000","last_peered":"2024-09-16T16:48:24.103145+0000","last_clean":"2024-09-16T16:48:24.103145+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:48:24.103145+0000","last_undegraded":"2024-09-16T16:48:24.103145+0000","last_fullsized":"2024-09-16T16:48:24.103145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.587029+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:48:23.587029+0000","last_peered":"2024-09-16T16:48:23.587029+0000","last_clean":"2024-09-16T16:48:23.587029+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:48:23.587029+0000","last_undegraded":"2024-09-16T16:48:23.587029+0000","last_fullsized":"2024-09-16T16:48:23.587029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372284+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:00.372284+0000","last_peered":"2024-09-16T16:48:00.372284+0000","last_clean":"2024-09-16T16:48:00.372284+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:00.372284+0000","last_undegraded":"2024-09-16T16:48:00.372284+0000","last_fullsized":"2024-09-16T16:48:00.372284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.335097+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:00.335097+0000","last_peered":"2024-09-16T16:48:00.335097+0000","last_clean":"2024-09-16T16:48:00.335097+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:00.335097+0000","last_undegraded":"2024-09-16T16:48:00.335097+0000","last_fullsized":"2024-09-16T16:48:00.335097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.851279+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:48:23.851279+0000","last_peered":"2024-09-16T16:48:23.851279+0000","last_clean":"2024-09-16T16:48:23.851279+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:48:23.851279+0000","last_undegraded":"2024-09-16T16:48:23.851279+0000","last_fullsized":"2024-09-16T16:48:23.851279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.364553+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:00.364553+0000","last_peered":"2024-09-16T16:48:00.364553+0000","last_clean":"2024-09-16T16:48:00.364553+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:00.364553+0000","last_undegraded":"2024-09-16T16:48:00.364553+0000","last_fullsized":"2024-09-16T16:48:00.364553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.416647+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:48:22.416647+0000","last_peered":"2024-09-16T16:48:22.416647+0000","last_clean":"2024-09-16T16:48:22.416647+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:48:22.416647+0000","last_undegraded":"2024-09-16T16:48:22.416647+0000","last_fullsized":"2024-09-16T16:48:22.416647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.321944+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:00.321944+0000","last_peered":"2024-09-16T16:48:00.321944+0000","last_clean":"2024-09-16T16:48:00.321944+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:00.321944+0000","last_undegraded":"2024-09-16T16:48:00.321944+0000","last_fullsized":"2024-09-16T16:48:00.321944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.650089+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:48:19.650089+0000","last_peered":"2024-09-16T16:48:19.650089+0000","last_clean":"2024-09-16T16:48:19.650089+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:48:19.650089+0000","last_undegraded":"2024-09-16T16:48:19.650089+0000","last_fullsized":"2024-09-16T16:48:19.650089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.359091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:00.359091+0000","last_peered":"2024-09-16T16:48:00.359091+0000","last_clean":"2024-09-16T16:48:00.359091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:00.359091+0000","last_undegraded":"2024-09-16T16:48:00.359091+0000","last_fullsized":"2024-09-16T16:48:00.359091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"24'568","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.611258+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:48:21.611258+0000","last_peered":"2024-09-16T16:48:21.611258+0000","last_clean":"2024-09-16T16:48:21.611258+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:48:21.611258+0000","last_undegraded":"2024-09-16T16:48:21.611258+0000","last_fullsized":"2024-09-16T16:48:21.611258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.995276+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:48:22.995276+0000","last_peered":"2024-09-16T16:48:22.995276+0000","last_clean":"2024-09-16T16:48:22.995276+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:48:22.995276+0000","last_undegraded":"2024-09-16T16:48:22.995276+0000","last_fullsized":"2024-09-16T16:48:22.995276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.314060+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:00.314060+0000","last_peered":"2024-09-16T16:48:00.314060+0000","last_clean":"2024-09-16T16:48:00.314060+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:00.314060+0000","last_undegraded":"2024-09-16T16:48:00.314060+0000","last_fullsized":"2024-09-16T16:48:00.314060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"24'551","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.377023+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:48:24.377023+0000","last_peered":"2024-09-16T16:48:24.377023+0000","last_clean":"2024-09-16T16:48:24.377023+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:48:24.377023+0000","last_undegraded":"2024-09-16T16:48:24.377023+0000","last_fullsized":"2024-09-16T16:48:24.377023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513792,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372092+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:00.372092+0000","last_peered":"2024-09-16T16:48:00.372092+0000","last_clean":"2024-09-16T16:48:00.372092+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:00.372092+0000","last_undegraded":"2024-09-16T16:48:00.372092+0000","last_fullsized":"2024-09-16T16:48:00.372092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.948201+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:48:23.948201+0000","last_peered":"2024-09-16T16:48:23.948201+0000","last_clean":"2024-09-16T16:48:23.948201+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:48:23.948201+0000","last_undegraded":"2024-09-16T16:48:23.948201+0000","last_fullsized":"2024-09-16T16:48:23.948201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.311939+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:00.311939+0000","last_peered":"2024-09-16T16:48:00.311939+0000","last_clean":"2024-09-16T16:48:00.311939+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:00.311939+0000","last_undegraded":"2024-09-16T16:48:00.311939+0000","last_fullsized":"2024-09-16T16:48:00.311939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'416","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.001673+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:48:22.001673+0000","last_peered":"2024-09-16T16:48:22.001673+0000","last_clean":"2024-09-16T16:48:22.001673+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:48:22.001673+0000","last_undegraded":"2024-09-16T16:48:22.001673+0000","last_fullsized":"2024-09-16T16:48:22.001673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.328676+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:00.328676+0000","last_peered":"2024-09-16T16:48:00.328676+0000","last_clean":"2024-09-16T16:48:00.328676+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:00.328676+0000","last_undegraded":"2024-09-16T16:48:00.328676+0000","last_fullsized":"2024-09-16T16:48:00.328676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":67624960,"num_objects":1032,"num_object_clones":0,"num_object_copies":3096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8255,"num_write_kb":66040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8255,"ondisk_log_size":8255,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":119584,"kb_used_data":119584,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52178144,"statfs":{"total":53552873472,"available":53430419456,"internally_reserved":0,"allocated":122454016,"data_stored":122454016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93156,"kb_used_data":93156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204572,"statfs":{"total":53552873472,"available":53457481728,"internally_reserved":0,"allocated":95391744,"data_stored":95391744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102520,"kb_used_data":102520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195208,"statfs":{"total":53552873472,"available":53447892992,"internally_reserved":0,"allocated":104980480,"data_stored":104980480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101272,"kb_used_data":101272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52196456,"statfs":{"total":53552873472,"available":53449170944,"internally_reserved":0,"allocated":103702528,"data_stored":103702528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:35.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 9343 9327 0.847211 0.789062 0.269157 0.147322 2024-09-16T16:48:35.618 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:35.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:35.757+0000 7f10198bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:35.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:35.767+0000 7f10198bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:36.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 9465 9449 0.848427 0.953125 0.211105 0.147208 2024-09-16T16:48:37.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 16 9570 9554 0.848107 0.820312 0.116098 0.147276 2024-09-16T16:48:38.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:38.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:38.185+0000 7efe96874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:38.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:38.194+0000 7efe96874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:38.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 9667 9651 0.847092 0.757812 0.161948 0.147413 2024-09-16T16:48:39.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 15 9765 9750 0.846272 0.773438 0.159196 0.147594 2024-09-16T16:48:40.229 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:40.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:48:40.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.1281 2024-09-16T16:48:40.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 9765 2024-09-16T16:48:40.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T16:48:40.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T16:48:40.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.846451 2024-09-16T16:48:40.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.0947324 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 1.01562 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.617188 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 108 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 12.1257 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 130 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 79 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.147573 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.0784661 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 0.678722 2024-09-16T16:48:40.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0185597 2024-09-16T16:48:40.340 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:48:40.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:40.356+0000 7fe68ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:40.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:40.378+0000 7fe68dd2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:40.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:40.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:40.704+0000 7f1bf5646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:40.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:40.734+0000 7f1bf5646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:41.342 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:48:41.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:48:41.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:41.534+0000 7fe3a42fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:41.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:41.558+0000 7fe3a42fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:42.343 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:48:42.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:48:42.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:42.525+0000 7f8189991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:42.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:42.538+0000 7f8189991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:43.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:43.319+0000 7f5c50791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:43.333+0000 7f5c50791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:43.349 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:48:43.368 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:48:43.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:43.543+0000 7fc73d2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:43.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:43.562+0000 7fc73d2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:48:44.375 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:48:44.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:44.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:44.522+0000 7f60d8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:44.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:44.538+0000 7f60d8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:44.915 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-16T16:48:44.385284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68215347,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8336,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8310,"ondisk_log_size":8310,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":416532,"kb_used_data":416532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208774380,"statfs":{"total":214211493888,"available":213784965120,"internally_reserved":0,"allocated":426528768,"data_stored":426528768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000799"},"pg_stats":[{"pgid":"3.f","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.281599+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:48:24.281599+0000","last_peered":"2024-09-16T16:48:24.281599+0000","last_clean":"2024-09-16T16:48:24.281599+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:48:24.281599+0000","last_undegraded":"2024-09-16T16:48:24.281599+0000","last_fullsized":"2024-09-16T16:48:24.281599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'384","reported_seq":408,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.465764+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:48:22.465764+0000","last_peered":"2024-09-16T16:48:22.465764+0000","last_clean":"2024-09-16T16:48:22.465764+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:48:22.465764+0000","last_undegraded":"2024-09-16T16:48:22.465764+0000","last_fullsized":"2024-09-16T16:48:22.465764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'480","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.562624+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:48:21.562624+0000","last_peered":"2024-09-16T16:48:21.562624+0000","last_clean":"2024-09-16T16:48:21.562624+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:48:21.562624+0000","last_undegraded":"2024-09-16T16:48:21.562624+0000","last_fullsized":"2024-09-16T16:48:21.562624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.012021+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:48:24.012021+0000","last_peered":"2024-09-16T16:48:24.012021+0000","last_clean":"2024-09-16T16:48:24.012021+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:48:24.012021+0000","last_undegraded":"2024-09-16T16:48:24.012021+0000","last_fullsized":"2024-09-16T16:48:24.012021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'472","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.802980+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:48:19.802980+0000","last_peered":"2024-09-16T16:48:19.802980+0000","last_clean":"2024-09-16T16:48:19.802980+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:48:19.802980+0000","last_undegraded":"2024-09-16T16:48:19.802980+0000","last_fullsized":"2024-09-16T16:48:19.802980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'600","reported_seq":624,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.862520+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:48:22.862520+0000","last_peered":"2024-09-16T16:48:22.862520+0000","last_clean":"2024-09-16T16:48:22.862520+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:48:22.862520+0000","last_undegraded":"2024-09-16T16:48:22.862520+0000","last_fullsized":"2024-09-16T16:48:22.862520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'528","reported_seq":552,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.103145+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:48:24.103145+0000","last_peered":"2024-09-16T16:48:24.103145+0000","last_clean":"2024-09-16T16:48:24.103145+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:48:24.103145+0000","last_undegraded":"2024-09-16T16:48:24.103145+0000","last_fullsized":"2024-09-16T16:48:24.103145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.587029+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:48:23.587029+0000","last_peered":"2024-09-16T16:48:23.587029+0000","last_clean":"2024-09-16T16:48:23.587029+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:48:23.587029+0000","last_undegraded":"2024-09-16T16:48:23.587029+0000","last_fullsized":"2024-09-16T16:48:23.587029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372284+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:00.372284+0000","last_peered":"2024-09-16T16:48:00.372284+0000","last_clean":"2024-09-16T16:48:00.372284+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:00.372284+0000","last_undegraded":"2024-09-16T16:48:00.372284+0000","last_fullsized":"2024-09-16T16:48:00.372284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.335097+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:00.335097+0000","last_peered":"2024-09-16T16:48:00.335097+0000","last_clean":"2024-09-16T16:48:00.335097+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:00.335097+0000","last_undegraded":"2024-09-16T16:48:00.335097+0000","last_fullsized":"2024-09-16T16:48:00.335097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.851279+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:48:23.851279+0000","last_peered":"2024-09-16T16:48:23.851279+0000","last_clean":"2024-09-16T16:48:23.851279+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:48:23.851279+0000","last_undegraded":"2024-09-16T16:48:23.851279+0000","last_fullsized":"2024-09-16T16:48:23.851279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.364553+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:00.364553+0000","last_peered":"2024-09-16T16:48:00.364553+0000","last_clean":"2024-09-16T16:48:00.364553+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:00.364553+0000","last_undegraded":"2024-09-16T16:48:00.364553+0000","last_fullsized":"2024-09-16T16:48:00.364553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.416647+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:48:22.416647+0000","last_peered":"2024-09-16T16:48:22.416647+0000","last_clean":"2024-09-16T16:48:22.416647+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:48:22.416647+0000","last_undegraded":"2024-09-16T16:48:22.416647+0000","last_fullsized":"2024-09-16T16:48:22.416647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.321944+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:00.321944+0000","last_peered":"2024-09-16T16:48:00.321944+0000","last_clean":"2024-09-16T16:48:00.321944+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:00.321944+0000","last_undegraded":"2024-09-16T16:48:00.321944+0000","last_fullsized":"2024-09-16T16:48:00.321944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.650089+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:48:19.650089+0000","last_peered":"2024-09-16T16:48:19.650089+0000","last_clean":"2024-09-16T16:48:19.650089+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:48:19.650089+0000","last_undegraded":"2024-09-16T16:48:19.650089+0000","last_fullsized":"2024-09-16T16:48:19.650089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.359091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:00.359091+0000","last_peered":"2024-09-16T16:48:00.359091+0000","last_clean":"2024-09-16T16:48:00.359091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:00.359091+0000","last_undegraded":"2024-09-16T16:48:00.359091+0000","last_fullsized":"2024-09-16T16:48:00.359091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"24'568","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.611258+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:48:21.611258+0000","last_peered":"2024-09-16T16:48:21.611258+0000","last_clean":"2024-09-16T16:48:21.611258+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:48:21.611258+0000","last_undegraded":"2024-09-16T16:48:21.611258+0000","last_fullsized":"2024-09-16T16:48:21.611258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.995276+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:48:22.995276+0000","last_peered":"2024-09-16T16:48:22.995276+0000","last_clean":"2024-09-16T16:48:22.995276+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:48:22.995276+0000","last_undegraded":"2024-09-16T16:48:22.995276+0000","last_fullsized":"2024-09-16T16:48:22.995276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.314060+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:00.314060+0000","last_peered":"2024-09-16T16:48:00.314060+0000","last_clean":"2024-09-16T16:48:00.314060+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:00.314060+0000","last_undegraded":"2024-09-16T16:48:00.314060+0000","last_fullsized":"2024-09-16T16:48:00.314060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"24'551","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.377023+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:48:24.377023+0000","last_peered":"2024-09-16T16:48:24.377023+0000","last_clean":"2024-09-16T16:48:24.377023+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:48:24.377023+0000","last_undegraded":"2024-09-16T16:48:24.377023+0000","last_fullsized":"2024-09-16T16:48:24.377023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513792,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372092+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:00.372092+0000","last_peered":"2024-09-16T16:48:00.372092+0000","last_clean":"2024-09-16T16:48:00.372092+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:00.372092+0000","last_undegraded":"2024-09-16T16:48:00.372092+0000","last_fullsized":"2024-09-16T16:48:00.372092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.948201+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:48:23.948201+0000","last_peered":"2024-09-16T16:48:23.948201+0000","last_clean":"2024-09-16T16:48:23.948201+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:48:23.948201+0000","last_undegraded":"2024-09-16T16:48:23.948201+0000","last_fullsized":"2024-09-16T16:48:23.948201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.311939+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:00.311939+0000","last_peered":"2024-09-16T16:48:00.311939+0000","last_clean":"2024-09-16T16:48:00.311939+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:00.311939+0000","last_undegraded":"2024-09-16T16:48:00.311939+0000","last_fullsized":"2024-09-16T16:48:00.311939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'416","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.001673+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:48:22.001673+0000","last_peered":"2024-09-16T16:48:22.001673+0000","last_clean":"2024-09-16T16:48:22.001673+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:48:22.001673+0000","last_undegraded":"2024-09-16T16:48:22.001673+0000","last_fullsized":"2024-09-16T16:48:22.001673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.328676+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:00.328676+0000","last_peered":"2024-09-16T16:48:00.328676+0000","last_clean":"2024-09-16T16:48:00.328676+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:00.328676+0000","last_undegraded":"2024-09-16T16:48:00.328676+0000","last_fullsized":"2024-09-16T16:48:00.328676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":67624960,"num_objects":1032,"num_object_clones":0,"num_object_copies":3096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8255,"num_write_kb":66040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8255,"ondisk_log_size":8255,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":119584,"kb_used_data":119584,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52178144,"statfs":{"total":53552873472,"available":53430419456,"internally_reserved":0,"allocated":122454016,"data_stored":122454016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93156,"kb_used_data":93156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204572,"statfs":{"total":53552873472,"available":53457481728,"internally_reserved":0,"allocated":95391744,"data_stored":95391744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102520,"kb_used_data":102520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195208,"statfs":{"total":53552873472,"available":53447892992,"internally_reserved":0,"allocated":104980480,"data_stored":104980480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101272,"kb_used_data":101272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52196456,"statfs":{"total":53552873472,"available":53449170944,"internally_reserved":0,"allocated":103702528,"data_stored":103702528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:44.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:45.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:45.086+0000 7fed8ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:45.106+0000 7fed8ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.498 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:45.499 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:45.519 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-16T16:48:44.385284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68215347,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8336,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8310,"ondisk_log_size":8310,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":416532,"kb_used_data":416532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208774380,"statfs":{"total":214211493888,"available":213784965120,"internally_reserved":0,"allocated":426528768,"data_stored":426528768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000799"},"pg_stats":[{"pgid":"3.f","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.281599+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:48:24.281599+0000","last_peered":"2024-09-16T16:48:24.281599+0000","last_clean":"2024-09-16T16:48:24.281599+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:48:24.281599+0000","last_undegraded":"2024-09-16T16:48:24.281599+0000","last_fullsized":"2024-09-16T16:48:24.281599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'384","reported_seq":408,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.465764+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:48:22.465764+0000","last_peered":"2024-09-16T16:48:22.465764+0000","last_clean":"2024-09-16T16:48:22.465764+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:48:22.465764+0000","last_undegraded":"2024-09-16T16:48:22.465764+0000","last_fullsized":"2024-09-16T16:48:22.465764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'480","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.562624+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:48:21.562624+0000","last_peered":"2024-09-16T16:48:21.562624+0000","last_clean":"2024-09-16T16:48:21.562624+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:48:21.562624+0000","last_undegraded":"2024-09-16T16:48:21.562624+0000","last_fullsized":"2024-09-16T16:48:21.562624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.012021+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:48:24.012021+0000","last_peered":"2024-09-16T16:48:24.012021+0000","last_clean":"2024-09-16T16:48:24.012021+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:48:24.012021+0000","last_undegraded":"2024-09-16T16:48:24.012021+0000","last_fullsized":"2024-09-16T16:48:24.012021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'472","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.802980+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:48:19.802980+0000","last_peered":"2024-09-16T16:48:19.802980+0000","last_clean":"2024-09-16T16:48:19.802980+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:48:19.802980+0000","last_undegraded":"2024-09-16T16:48:19.802980+0000","last_fullsized":"2024-09-16T16:48:19.802980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'600","reported_seq":624,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.862520+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:48:22.862520+0000","last_peered":"2024-09-16T16:48:22.862520+0000","last_clean":"2024-09-16T16:48:22.862520+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:48:22.862520+0000","last_undegraded":"2024-09-16T16:48:22.862520+0000","last_fullsized":"2024-09-16T16:48:22.862520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'528","reported_seq":552,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.103145+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:48:24.103145+0000","last_peered":"2024-09-16T16:48:24.103145+0000","last_clean":"2024-09-16T16:48:24.103145+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:48:24.103145+0000","last_undegraded":"2024-09-16T16:48:24.103145+0000","last_fullsized":"2024-09-16T16:48:24.103145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.587029+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:48:23.587029+0000","last_peered":"2024-09-16T16:48:23.587029+0000","last_clean":"2024-09-16T16:48:23.587029+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:48:23.587029+0000","last_undegraded":"2024-09-16T16:48:23.587029+0000","last_fullsized":"2024-09-16T16:48:23.587029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372284+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:00.372284+0000","last_peered":"2024-09-16T16:48:00.372284+0000","last_clean":"2024-09-16T16:48:00.372284+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:00.372284+0000","last_undegraded":"2024-09-16T16:48:00.372284+0000","last_fullsized":"2024-09-16T16:48:00.372284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.335097+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:00.335097+0000","last_peered":"2024-09-16T16:48:00.335097+0000","last_clean":"2024-09-16T16:48:00.335097+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:00.335097+0000","last_undegraded":"2024-09-16T16:48:00.335097+0000","last_fullsized":"2024-09-16T16:48:00.335097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.851279+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:48:23.851279+0000","last_peered":"2024-09-16T16:48:23.851279+0000","last_clean":"2024-09-16T16:48:23.851279+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:48:23.851279+0000","last_undegraded":"2024-09-16T16:48:23.851279+0000","last_fullsized":"2024-09-16T16:48:23.851279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.364553+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:00.364553+0000","last_peered":"2024-09-16T16:48:00.364553+0000","last_clean":"2024-09-16T16:48:00.364553+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:00.364553+0000","last_undegraded":"2024-09-16T16:48:00.364553+0000","last_fullsized":"2024-09-16T16:48:00.364553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.416647+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:48:22.416647+0000","last_peered":"2024-09-16T16:48:22.416647+0000","last_clean":"2024-09-16T16:48:22.416647+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:48:22.416647+0000","last_undegraded":"2024-09-16T16:48:22.416647+0000","last_fullsized":"2024-09-16T16:48:22.416647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.321944+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:00.321944+0000","last_peered":"2024-09-16T16:48:00.321944+0000","last_clean":"2024-09-16T16:48:00.321944+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:00.321944+0000","last_undegraded":"2024-09-16T16:48:00.321944+0000","last_fullsized":"2024-09-16T16:48:00.321944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.650089+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:48:19.650089+0000","last_peered":"2024-09-16T16:48:19.650089+0000","last_clean":"2024-09-16T16:48:19.650089+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:48:19.650089+0000","last_undegraded":"2024-09-16T16:48:19.650089+0000","last_fullsized":"2024-09-16T16:48:19.650089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.359091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:00.359091+0000","last_peered":"2024-09-16T16:48:00.359091+0000","last_clean":"2024-09-16T16:48:00.359091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:00.359091+0000","last_undegraded":"2024-09-16T16:48:00.359091+0000","last_fullsized":"2024-09-16T16:48:00.359091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"24'568","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.611258+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:48:21.611258+0000","last_peered":"2024-09-16T16:48:21.611258+0000","last_clean":"2024-09-16T16:48:21.611258+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:48:21.611258+0000","last_undegraded":"2024-09-16T16:48:21.611258+0000","last_fullsized":"2024-09-16T16:48:21.611258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.995276+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:48:22.995276+0000","last_peered":"2024-09-16T16:48:22.995276+0000","last_clean":"2024-09-16T16:48:22.995276+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:48:22.995276+0000","last_undegraded":"2024-09-16T16:48:22.995276+0000","last_fullsized":"2024-09-16T16:48:22.995276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.314060+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:00.314060+0000","last_peered":"2024-09-16T16:48:00.314060+0000","last_clean":"2024-09-16T16:48:00.314060+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:00.314060+0000","last_undegraded":"2024-09-16T16:48:00.314060+0000","last_fullsized":"2024-09-16T16:48:00.314060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"24'551","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.377023+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:48:24.377023+0000","last_peered":"2024-09-16T16:48:24.377023+0000","last_clean":"2024-09-16T16:48:24.377023+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:48:24.377023+0000","last_undegraded":"2024-09-16T16:48:24.377023+0000","last_fullsized":"2024-09-16T16:48:24.377023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513792,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372092+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:00.372092+0000","last_peered":"2024-09-16T16:48:00.372092+0000","last_clean":"2024-09-16T16:48:00.372092+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:00.372092+0000","last_undegraded":"2024-09-16T16:48:00.372092+0000","last_fullsized":"2024-09-16T16:48:00.372092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.948201+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:48:23.948201+0000","last_peered":"2024-09-16T16:48:23.948201+0000","last_clean":"2024-09-16T16:48:23.948201+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:48:23.948201+0000","last_undegraded":"2024-09-16T16:48:23.948201+0000","last_fullsized":"2024-09-16T16:48:23.948201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.311939+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:00.311939+0000","last_peered":"2024-09-16T16:48:00.311939+0000","last_clean":"2024-09-16T16:48:00.311939+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:00.311939+0000","last_undegraded":"2024-09-16T16:48:00.311939+0000","last_fullsized":"2024-09-16T16:48:00.311939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'416","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.001673+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:48:22.001673+0000","last_peered":"2024-09-16T16:48:22.001673+0000","last_clean":"2024-09-16T16:48:22.001673+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:48:22.001673+0000","last_undegraded":"2024-09-16T16:48:22.001673+0000","last_fullsized":"2024-09-16T16:48:22.001673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.328676+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:00.328676+0000","last_peered":"2024-09-16T16:48:00.328676+0000","last_clean":"2024-09-16T16:48:00.328676+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:00.328676+0000","last_undegraded":"2024-09-16T16:48:00.328676+0000","last_fullsized":"2024-09-16T16:48:00.328676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":67624960,"num_objects":1032,"num_object_clones":0,"num_object_copies":3096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8255,"num_write_kb":66040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8255,"ondisk_log_size":8255,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":119584,"kb_used_data":119584,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52178144,"statfs":{"total":53552873472,"available":53430419456,"internally_reserved":0,"allocated":122454016,"data_stored":122454016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93156,"kb_used_data":93156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204572,"statfs":{"total":53552873472,"available":53457481728,"internally_reserved":0,"allocated":95391744,"data_stored":95391744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102520,"kb_used_data":102520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195208,"statfs":{"total":53552873472,"available":53447892992,"internally_reserved":0,"allocated":104980480,"data_stored":104980480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101272,"kb_used_data":101272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52196456,"statfs":{"total":53552873472,"available":53449170944,"internally_reserved":0,"allocated":103702528,"data_stored":103702528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:45.520 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:48:45.520 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:45.521 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:48:45.521 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:48:45.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:45.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:45.695+0000 7f63c8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:45.715+0000 7f63c359e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:45.819 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:45.819 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:45.823 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:45.823 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:45.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:48:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:45.867+0000 7fe8d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:45.879+0000 7fe8d212f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:46.043+0000 7f88fbb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:46.062+0000 7f88fbb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:46.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:46.096 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:46.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:48:46.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:46.315+0000 7fa7e8888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:46.332+0000 7fa7e8888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:46.417 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:46.418 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:46.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:48:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:46.569+0000 7f5ed1a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:46.590+0000 7f5ed1a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:48:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:48:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:48:46.712 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:48:46.712 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:48:48.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:48.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:48.359+0000 7fae17991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:48.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:48.370+0000 7fae17991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:50.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:50.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:50.810+0000 7fc9aa351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:50.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:50.820+0000 7fc9aa351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:51.713 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:51.713 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:48:51.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:48:51.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:51.833+0000 7f9771b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:51.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:51.843+0000 7f9771b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:51.858 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1221 objects 2024-09-16T16:48:51.858 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :11.5185 2024-09-16T16:48:52.055 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:48:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:48:52.068 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-16T16:48:50.386384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68215347,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8336,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8310,"ondisk_log_size":8310,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":416532,"kb_used_data":416532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208774380,"statfs":{"total":214211493888,"available":213784965120,"internally_reserved":0,"allocated":426528768,"data_stored":426528768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001450"},"pg_stats":[{"pgid":"3.f","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.281599+0000","last_change":"2024-09-16T16:47:08.388343+0000","last_active":"2024-09-16T16:48:24.281599+0000","last_peered":"2024-09-16T16:48:24.281599+0000","last_clean":"2024-09-16T16:48:24.281599+0000","last_became_active":"2024-09-16T16:47:08.371567+0000","last_became_peered":"2024-09-16T16:47:08.371567+0000","last_unstale":"2024-09-16T16:48:24.281599+0000","last_undegraded":"2024-09-16T16:48:24.281599+0000","last_fullsized":"2024-09-16T16:48:24.281599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"24'384","reported_seq":408,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.465764+0000","last_change":"2024-09-16T16:47:08.356553+0000","last_active":"2024-09-16T16:48:22.465764+0000","last_peered":"2024-09-16T16:48:22.465764+0000","last_clean":"2024-09-16T16:48:22.465764+0000","last_became_active":"2024-09-16T16:47:08.331769+0000","last_became_peered":"2024-09-16T16:47:08.331769+0000","last_unstale":"2024-09-16T16:48:22.465764+0000","last_undegraded":"2024-09-16T16:48:22.465764+0000","last_fullsized":"2024-09-16T16:48:22.465764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'480","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.562624+0000","last_change":"2024-09-16T16:47:08.437919+0000","last_active":"2024-09-16T16:48:21.562624+0000","last_peered":"2024-09-16T16:48:21.562624+0000","last_clean":"2024-09-16T16:48:21.562624+0000","last_became_active":"2024-09-16T16:47:08.430762+0000","last_became_peered":"2024-09-16T16:47:08.430762+0000","last_unstale":"2024-09-16T16:48:21.562624+0000","last_undegraded":"2024-09-16T16:48:21.562624+0000","last_fullsized":"2024-09-16T16:48:21.562624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.012021+0000","last_change":"2024-09-16T16:47:08.422891+0000","last_active":"2024-09-16T16:48:24.012021+0000","last_peered":"2024-09-16T16:48:24.012021+0000","last_clean":"2024-09-16T16:48:24.012021+0000","last_became_active":"2024-09-16T16:47:08.396393+0000","last_became_peered":"2024-09-16T16:47:08.396393+0000","last_unstale":"2024-09-16T16:48:24.012021+0000","last_undegraded":"2024-09-16T16:48:24.012021+0000","last_fullsized":"2024-09-16T16:48:24.012021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'472","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.802980+0000","last_change":"2024-09-16T16:47:08.357581+0000","last_active":"2024-09-16T16:48:19.802980+0000","last_peered":"2024-09-16T16:48:19.802980+0000","last_clean":"2024-09-16T16:48:19.802980+0000","last_became_active":"2024-09-16T16:47:08.347855+0000","last_became_peered":"2024-09-16T16:47:08.347855+0000","last_unstale":"2024-09-16T16:48:19.802980+0000","last_undegraded":"2024-09-16T16:48:19.802980+0000","last_fullsized":"2024-09-16T16:48:19.802980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'600","reported_seq":624,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.862520+0000","last_change":"2024-09-16T16:47:08.452165+0000","last_active":"2024-09-16T16:48:22.862520+0000","last_peered":"2024-09-16T16:48:22.862520+0000","last_clean":"2024-09-16T16:48:22.862520+0000","last_became_active":"2024-09-16T16:47:08.444087+0000","last_became_peered":"2024-09-16T16:47:08.444087+0000","last_unstale":"2024-09-16T16:48:22.862520+0000","last_undegraded":"2024-09-16T16:48:22.862520+0000","last_fullsized":"2024-09-16T16:48:22.862520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"24'528","reported_seq":552,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.103145+0000","last_change":"2024-09-16T16:47:08.446425+0000","last_active":"2024-09-16T16:48:24.103145+0000","last_peered":"2024-09-16T16:48:24.103145+0000","last_clean":"2024-09-16T16:48:24.103145+0000","last_became_active":"2024-09-16T16:47:08.430290+0000","last_became_peered":"2024-09-16T16:47:08.430290+0000","last_unstale":"2024-09-16T16:48:24.103145+0000","last_undegraded":"2024-09-16T16:48:24.103145+0000","last_fullsized":"2024-09-16T16:48:24.103145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"24'504","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.587029+0000","last_change":"2024-09-16T16:47:08.339862+0000","last_active":"2024-09-16T16:48:23.587029+0000","last_peered":"2024-09-16T16:48:23.587029+0000","last_clean":"2024-09-16T16:48:23.587029+0000","last_became_active":"2024-09-16T16:47:08.321231+0000","last_became_peered":"2024-09-16T16:47:08.321231+0000","last_unstale":"2024-09-16T16:48:23.587029+0000","last_undegraded":"2024-09-16T16:48:23.587029+0000","last_fullsized":"2024-09-16T16:48:23.587029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372284+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:00.372284+0000","last_peered":"2024-09-16T16:48:00.372284+0000","last_clean":"2024-09-16T16:48:00.372284+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:00.372284+0000","last_undegraded":"2024-09-16T16:48:00.372284+0000","last_fullsized":"2024-09-16T16:48:00.372284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.335097+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:00.335097+0000","last_peered":"2024-09-16T16:48:00.335097+0000","last_clean":"2024-09-16T16:48:00.335097+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:00.335097+0000","last_undegraded":"2024-09-16T16:48:00.335097+0000","last_fullsized":"2024-09-16T16:48:00.335097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.851279+0000","last_change":"2024-09-16T16:47:08.344079+0000","last_active":"2024-09-16T16:48:23.851279+0000","last_peered":"2024-09-16T16:48:23.851279+0000","last_clean":"2024-09-16T16:48:23.851279+0000","last_became_active":"2024-09-16T16:47:08.337144+0000","last_became_peered":"2024-09-16T16:47:08.337144+0000","last_unstale":"2024-09-16T16:48:23.851279+0000","last_undegraded":"2024-09-16T16:48:23.851279+0000","last_fullsized":"2024-09-16T16:48:23.851279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.364553+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:00.364553+0000","last_peered":"2024-09-16T16:48:00.364553+0000","last_clean":"2024-09-16T16:48:00.364553+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:00.364553+0000","last_undegraded":"2024-09-16T16:48:00.364553+0000","last_fullsized":"2024-09-16T16:48:00.364553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.416647+0000","last_change":"2024-09-16T16:47:08.516640+0000","last_active":"2024-09-16T16:48:22.416647+0000","last_peered":"2024-09-16T16:48:22.416647+0000","last_clean":"2024-09-16T16:48:22.416647+0000","last_became_active":"2024-09-16T16:47:08.508293+0000","last_became_peered":"2024-09-16T16:47:08.508293+0000","last_unstale":"2024-09-16T16:48:22.416647+0000","last_undegraded":"2024-09-16T16:48:22.416647+0000","last_fullsized":"2024-09-16T16:48:22.416647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.321944+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:00.321944+0000","last_peered":"2024-09-16T16:48:00.321944+0000","last_clean":"2024-09-16T16:48:00.321944+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:00.321944+0000","last_undegraded":"2024-09-16T16:48:00.321944+0000","last_fullsized":"2024-09-16T16:48:00.321944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:19.650089+0000","last_change":"2024-09-16T16:47:08.397283+0000","last_active":"2024-09-16T16:48:19.650089+0000","last_peered":"2024-09-16T16:48:19.650089+0000","last_clean":"2024-09-16T16:48:19.650089+0000","last_became_active":"2024-09-16T16:47:08.379856+0000","last_became_peered":"2024-09-16T16:47:08.379856+0000","last_unstale":"2024-09-16T16:48:19.650089+0000","last_undegraded":"2024-09-16T16:48:19.650089+0000","last_fullsized":"2024-09-16T16:48:19.650089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.359091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:00.359091+0000","last_peered":"2024-09-16T16:48:00.359091+0000","last_clean":"2024-09-16T16:48:00.359091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:00.359091+0000","last_undegraded":"2024-09-16T16:48:00.359091+0000","last_fullsized":"2024-09-16T16:48:00.359091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"24'568","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:21.611258+0000","last_change":"2024-09-16T16:47:08.411776+0000","last_active":"2024-09-16T16:48:21.611258+0000","last_peered":"2024-09-16T16:48:21.611258+0000","last_clean":"2024-09-16T16:48:21.611258+0000","last_became_active":"2024-09-16T16:47:08.387388+0000","last_became_peered":"2024-09-16T16:47:08.387388+0000","last_unstale":"2024-09-16T16:48:21.611258+0000","last_undegraded":"2024-09-16T16:48:21.611258+0000","last_fullsized":"2024-09-16T16:48:21.611258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"24'544","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.995276+0000","last_change":"2024-09-16T16:47:08.422541+0000","last_active":"2024-09-16T16:48:22.995276+0000","last_peered":"2024-09-16T16:48:22.995276+0000","last_clean":"2024-09-16T16:48:22.995276+0000","last_became_active":"2024-09-16T16:47:08.409514+0000","last_became_peered":"2024-09-16T16:47:08.409514+0000","last_unstale":"2024-09-16T16:48:22.995276+0000","last_undegraded":"2024-09-16T16:48:22.995276+0000","last_fullsized":"2024-09-16T16:48:22.995276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.314060+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:00.314060+0000","last_peered":"2024-09-16T16:48:00.314060+0000","last_clean":"2024-09-16T16:48:00.314060+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:00.314060+0000","last_undegraded":"2024-09-16T16:48:00.314060+0000","last_fullsized":"2024-09-16T16:48:00.314060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"24'551","reported_seq":575,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:24.377023+0000","last_change":"2024-09-16T16:47:08.378939+0000","last_active":"2024-09-16T16:48:24.377023+0000","last_peered":"2024-09-16T16:48:24.377023+0000","last_clean":"2024-09-16T16:48:24.377023+0000","last_became_active":"2024-09-16T16:47:08.364767+0000","last_became_peered":"2024-09-16T16:47:08.364767+0000","last_unstale":"2024-09-16T16:48:24.377023+0000","last_undegraded":"2024-09-16T16:48:24.377023+0000","last_fullsized":"2024-09-16T16:48:24.377023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513792,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.372092+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:00.372092+0000","last_peered":"2024-09-16T16:48:00.372092+0000","last_clean":"2024-09-16T16:48:00.372092+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:00.372092+0000","last_undegraded":"2024-09-16T16:48:00.372092+0000","last_fullsized":"2024-09-16T16:48:00.372092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'608","reported_seq":632,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:23.948201+0000","last_change":"2024-09-16T16:47:08.483605+0000","last_active":"2024-09-16T16:48:23.948201+0000","last_peered":"2024-09-16T16:48:23.948201+0000","last_clean":"2024-09-16T16:48:23.948201+0000","last_became_active":"2024-09-16T16:47:08.476434+0000","last_became_peered":"2024-09-16T16:47:08.476434+0000","last_unstale":"2024-09-16T16:48:23.948201+0000","last_undegraded":"2024-09-16T16:48:23.948201+0000","last_fullsized":"2024-09-16T16:48:23.948201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.311939+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:00.311939+0000","last_peered":"2024-09-16T16:48:00.311939+0000","last_clean":"2024-09-16T16:48:00.311939+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:00.311939+0000","last_undegraded":"2024-09-16T16:48:00.311939+0000","last_fullsized":"2024-09-16T16:48:00.311939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'416","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:22.001673+0000","last_change":"2024-09-16T16:47:08.369511+0000","last_active":"2024-09-16T16:48:22.001673+0000","last_peered":"2024-09-16T16:48:22.001673+0000","last_clean":"2024-09-16T16:48:22.001673+0000","last_became_active":"2024-09-16T16:47:08.345005+0000","last_became_peered":"2024-09-16T16:47:08.345005+0000","last_unstale":"2024-09-16T16:48:22.001673+0000","last_undegraded":"2024-09-16T16:48:22.001673+0000","last_fullsized":"2024-09-16T16:48:22.001673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:47:07.199648+0000","last_clean_scrub_stamp":"2024-09-16T16:47:07.199648+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T16:48:00.328676+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:00.328676+0000","last_peered":"2024-09-16T16:48:00.328676+0000","last_clean":"2024-09-16T16:48:00.328676+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:00.328676+0000","last_undegraded":"2024-09-16T16:48:00.328676+0000","last_fullsized":"2024-09-16T16:48:00.328676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":67624960,"num_objects":1032,"num_object_clones":0,"num_object_copies":3096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8255,"num_write_kb":66040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8255,"ondisk_log_size":8255,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213784571904,"internally_reserved":0,"allocated":426921984,"data_stored":426921984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":119584,"kb_used_data":119584,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52178144,"statfs":{"total":53552873472,"available":53430419456,"internally_reserved":0,"allocated":122454016,"data_stored":122454016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93156,"kb_used_data":93156,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204572,"statfs":{"total":53552873472,"available":53457481728,"internally_reserved":0,"allocated":95391744,"data_stored":95391744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":102520,"kb_used_data":102520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52195208,"statfs":{"total":53552873472,"available":53447892992,"internally_reserved":0,"allocated":104980480,"data_stored":104980480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":101272,"kb_used_data":101272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52196456,"statfs":{"total":53552873472,"available":53449170944,"internally_reserved":0,"allocated":103702528,"data_stored":103702528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53449048064,"internally_reserved":0,"allocated":103825408,"data_stored":103825408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53447860224,"internally_reserved":0,"allocated":105013248,"data_stored":105013248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53457383424,"internally_reserved":0,"allocated":95490048,"data_stored":95490048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53430280192,"internally_reserved":0,"allocated":122593280,"data_stored":122593280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:48:52.947 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-16T16:48:52.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-16T16:48:52.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:53.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:53.073+0000 7f9274b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:53.089+0000 7f9274b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:53.111+0000 7f7bd2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:53.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:53.117+0000 7f7bd2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:54.061 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_0' removed 2024-09-16T16:48:54.088 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:48:54.089 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:48:54.089 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-16T16:48:54.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-16T16:48:54.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:54.262+0000 7f7a79b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:54.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:54.285+0000 7f7a79b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_1' created 2024-09-16T16:48:55.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-16T16:48:55.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:48:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:55.237+0000 7fab90f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:55.252+0000 7fab90f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:55.346+0000 7f93c9846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:55.352+0000 7f93c9846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:56.071 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-16T16:48:57.070 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:48:57.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:48:57.093 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-16T16:48:57.116 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:48:57.116 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:48:57.188 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:48:57.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:48:57.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_34113 2024-09-16T16:48:57.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:48:57.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:48:57.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:57.200+0000 7f005a6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:57.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:57.211+0000 7f005a6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:57.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:48:57.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:57.634+0000 7f3c06d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:57.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:57.641+0000 7f3c06d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:58.080 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:48:58.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:48:58.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 111 95 0.742132 0.742188 0.194561 0.128457 2024-09-16T16:48:58.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:58.213+0000 7f982a474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:58.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:58.226+0000 7f982a474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:59.083 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:48:59.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:48:59.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 213 197 0.769466 0.796875 0.0903093 0.154782 2024-09-16T16:48:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:59.253+0000 7ff4d0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:59.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:48:59.268+0000 7ff4d0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:48:59.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:00.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:00.083+0000 7fcd0c67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:00.089 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:49:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:00.101+0000 7fcd0c67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:00.116 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:49:00.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 326 310 0.807216 0.882812 0.11979 0.150542 2024-09-16T16:49:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:00.238+0000 7f6a72591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:00.252+0000 7f6a72591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:01.096 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:49:01.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:49:01.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:01.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 16 425 409 0.798753 0.773438 0.111694 0.152924 2024-09-16T16:49:01.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:01.268+0000 7f54b2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:01.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:01.280+0000 7f54b2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:01.556 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:01.576 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-16T16:49:01.097257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017358"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:01.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:01.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:01.713+0000 7f0264cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:01.723+0000 7f0264cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:02.072 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-16T16:49:01.097257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017358"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:02.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:49:02.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 508 492 0.768676 0.648438 0.279967 0.158745 2024-09-16T16:49:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:02.196+0000 7fac71e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:02.205+0000 7fac71e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:02.489 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:02.489 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":135,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":36,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":14868480,"bytes_avail":214196625408,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:49:02.513 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:49:02.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:02.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:02.591+0000 7fe73f074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:02.599+0000 7fe73f074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:02.661+0000 7fd731511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:02.673+0000 7fd731511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:02.964 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:02.964 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:02.990 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-09-16T16:49:02.388743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.308101"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:03.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 619 603 0.785079 0.867188 0.130125 0.156624 2024-09-16T16:49:04.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 732 716 0.799029 0.882812 0.0898417 0.15499 2024-09-16T16:49:04.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:05.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:05.109+0000 7fd6042bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:05.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:05.117+0000 7fd6042bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:05.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 867 851 0.830973 1.05469 0.0769075 0.149306 2024-09-16T16:49:05.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:06.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:06.146+0000 7fd7db67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:06.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:06.159+0000 7fd7db67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:06.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 995 979 0.849744 1 0.0454951 0.145505 2024-09-16T16:49:06.419 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:06.442 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-16T16:49:06.389530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.305134"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:06.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:49:06.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:06.609+0000 7f4f71846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:06.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:06.619+0000 7f4f71846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:07.067 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:07.068 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":140,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":36,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":14868480,"bytes_avail":214196625408,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:49:07.083 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:49:07.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:07.189 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 1119 1103 0.861634 0.96875 0.240377 0.144062 2024-09-16T16:49:07.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:07.222+0000 7f5e6b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:07.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:07.233+0000 7f5e6b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:07.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:07.487 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:07.503 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-09-16T16:49:06.389530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.305134"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:07.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:07.643+0000 7f3ffcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:07.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:07.651+0000 7f3ffcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:08.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1220 1204 0.85503 0.789062 0.0820725 0.145476 2024-09-16T16:49:09.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1327 1311 0.853432 0.835938 0.0690454 0.145248 2024-09-16T16:49:09.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:10.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:10.077+0000 7f4dbc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:10.085+0000 7f4dbc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1416 1400 0.841263 0.695312 0.239146 0.147098 2024-09-16T16:49:10.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:10.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:10.622+0000 7f51e0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:10.633+0000 7f51e0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:10.995 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-16T16:49:10.390287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001976"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:10.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:49:11.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:11.137+0000 7eff42191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:11.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:11.150+0000 7eff42191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:11.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1526 1510 0.84255 0.859375 0.190318 0.14759 2024-09-16T16:49:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:11.651 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":36,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":14868480,"bytes_avail":214196625408,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:49:11.669 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:49:11.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:11.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:11.804+0000 7f0f2f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:11.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:11.817+0000 7f0f2f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:12.166 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:12.189 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-16T16:49:10.390287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001976"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:12.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1652 1636 0.851998 0.984375 0.148079 0.146144 2024-09-16T16:49:12.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:12.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:12.615+0000 7f52aa4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:12.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:12.622+0000 7f52aa4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:13.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1795 1779 0.868567 1.11719 0.125954 0.143435 2024-09-16T16:49:14.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1924 1908 0.876752 1.00781 0.102839 0.141652 2024-09-16T16:49:15.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:15.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 2038 2022 0.877518 0.890625 0.0989685 0.141857 2024-09-16T16:49:15.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:15.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:15.191+0000 7fb473cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:15.201+0000 7fb473cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:15.360+0000 7fd62bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:15.377+0000 7fd62bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.740 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:15.761 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-16T16:49:14.391011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002267"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:15.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:49:15.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:15.889+0000 7f68504d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:15.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:15.899+0000 7f68504d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:16.190 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 2139 2123 0.872858 0.789062 0.0989254 0.142382 2024-09-16T16:49:16.333 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:16.333 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":36,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":14868480,"bytes_avail":214196625408,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:49:16.356 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:49:16.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:16.486+0000 7f14b00fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:16.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:16.497+0000 7f14b00fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:16.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:16.719 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-16T16:49:16.391349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002268"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:17.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:49:17.191305+0000 min lat: 0.0214989 max lat: 0.728974 avg lat: 0.142324 2024-09-16T16:49:17.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:49:17.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2248 2232 0.87179 0.851562 0.208728 0.142324 2024-09-16T16:49:17.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:17.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:17.604+0000 7f6862991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:17.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:17.612+0000 7f6862991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:18.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 15 2349 2334 0.868219 0.796875 0.15938 0.143402 2024-09-16T16:49:19.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2477 2461 0.87385 0.992188 0.158548 0.142334 2024-09-16T16:49:19.722 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:19.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:19.845+0000 7fdea5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:19.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:19.857+0000 7fdea5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:19.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:20.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:20.104+0000 7f2ada8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:20.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:20.111+0000 7f2ada8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:20.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2598 2582 0.876953 0.945312 0.156316 0.141708 2024-09-16T16:49:20.204 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:20.204 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:20.221 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-16T16:49:18.391775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002244"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:20.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:49:20.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:20.359+0000 7fbc5d29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:20.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:20.369+0000 7fbc5d29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:20.654 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:20.654 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":153,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":36,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":14868480,"bytes_avail":214196625408,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:49:20.670 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:49:20.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:20.888+0000 7fe5bad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:20.903+0000 7fe5bad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:21.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:21.174 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:21.191 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-16T16:49:20.392142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":14520,"kb_used_data":14520,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209176392,"statfs":{"total":214211493888,"available":214196625408,"internally_reserved":0,"allocated":14868480,"data_stored":14868480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002226"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":127,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.083810+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:48:54.083810+0000","last_peered":"2024-09-16T16:48:54.083810+0000","last_clean":"2024-09-16T16:48:54.083810+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:48:54.083810+0000","last_undegraded":"2024-09-16T16:48:54.083810+0000","last_fullsized":"2024-09-16T16:48:54.083810+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.119182+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:48:54.119182+0000","last_peered":"2024-09-16T16:48:54.119182+0000","last_clean":"2024-09-16T16:48:54.119182+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:48:54.119182+0000","last_undegraded":"2024-09-16T16:48:54.119182+0000","last_fullsized":"2024-09-16T16:48:54.119182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.125873+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:48:54.125873+0000","last_peered":"2024-09-16T16:48:54.125873+0000","last_clean":"2024-09-16T16:48:54.125873+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:48:54.125873+0000","last_undegraded":"2024-09-16T16:48:54.125873+0000","last_fullsized":"2024-09-16T16:48:54.125873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.111645+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:48:54.111645+0000","last_peered":"2024-09-16T16:48:54.111645+0000","last_clean":"2024-09-16T16:48:54.111645+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:48:54.111645+0000","last_undegraded":"2024-09-16T16:48:54.111645+0000","last_fullsized":"2024-09-16T16:48:54.111645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214205358080,"internally_reserved":0,"allocated":6135808,"data_stored":6135808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4664,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293064,"statfs":{"total":53552873472,"available":53548097536,"internally_reserved":0,"allocated":4775936,"data_stored":4775936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2820,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294908,"statfs":{"total":53552873472,"available":53549985792,"internally_reserved":0,"allocated":2887680,"data_stored":2887680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53551058944,"internally_reserved":0,"allocated":1814528,"data_stored":1814528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551456256,"internally_reserved":0,"allocated":1417216,"data_stored":1417216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:21.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2706 2690 0.875566 0.84375 0.0229186 0.142205 2024-09-16T16:49:22.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2801 2785 0.870228 0.742188 0.23477 0.142971 2024-09-16T16:49:22.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:22.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:22.471+0000 7fa193711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:22.480+0000 7fa193711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:23.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 2907 2891 0.868606 0.828125 0.247546 0.143556 2024-09-16T16:49:24.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 3022 3006 0.869709 0.898438 0.0714551 0.143389 2024-09-16T16:49:24.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:24.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:24.363+0000 7f1fa64d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:24.375+0000 7f1fa64d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:24.637 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:24.661 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-16T16:49:24.392903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8913459,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1097,"num_write_kb":9236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1071,"ondisk_log_size":1071,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":81372,"kb_used_data":81372,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209109540,"statfs":{"total":214211493888,"available":214128168960,"internally_reserved":0,"allocated":83324928,"data_stored":83324928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002250"},"pg_stats":[{"pgid":"4.f","version":"36'152","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.204105+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:24.204105+0000","last_peered":"2024-09-16T16:49:24.204105+0000","last_clean":"2024-09-16T16:49:24.204105+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:24.204105+0000","last_undegraded":"2024-09-16T16:49:24.204105+0000","last_fullsized":"2024-09-16T16:49:24.204105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'232","reported_seq":256,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.029286+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:24.029286+0000","last_peered":"2024-09-16T16:49:24.029286+0000","last_clean":"2024-09-16T16:49:24.029286+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:24.029286+0000","last_undegraded":"2024-09-16T16:49:24.029286+0000","last_fullsized":"2024-09-16T16:49:24.029286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.267016+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:24.267016+0000","last_peered":"2024-09-16T16:49:24.267016+0000","last_clean":"2024-09-16T16:49:24.267016+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:24.267016+0000","last_undegraded":"2024-09-16T16:49:24.267016+0000","last_fullsized":"2024-09-16T16:49:24.267016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:22.006677+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:22.006677+0000","last_peered":"2024-09-16T16:49:22.006677+0000","last_clean":"2024-09-16T16:49:22.006677+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:22.006677+0000","last_undegraded":"2024-09-16T16:49:22.006677+0000","last_fullsized":"2024-09-16T16:49:22.006677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:20.980334+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:20.980334+0000","last_peered":"2024-09-16T16:49:20.980334+0000","last_clean":"2024-09-16T16:49:20.980334+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:20.980334+0000","last_undegraded":"2024-09-16T16:49:20.980334+0000","last_fullsized":"2024-09-16T16:49:20.980334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":107105746944,"available":107029340160,"internally_reserved":0,"allocated":76406784,"data_stored":76406784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":15,"acting":15,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214132183040,"internally_reserved":0,"allocated":79310848,"data_stored":79310848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":41664,"kb_used_data":41664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52256064,"statfs":{"total":53552873472,"available":53510209536,"internally_reserved":0,"allocated":42663936,"data_stored":42663936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32672,"kb_used_data":32672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52265056,"statfs":{"total":53552873472,"available":53519417344,"internally_reserved":0,"allocated":33456128,"data_stored":33456128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:24.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:49:24.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:24.832+0000 7fbcaeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:24.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:24.841+0000 7fbcaeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:24.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:24.854+0000 7f2e8986c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:24.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:24.863+0000 7f2e8986c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:25.175 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:25.175 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":158,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":36,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"unknown","count":11}],"num_pgs":25,"num_pools":3,"num_objects":131,"data_bytes":8913459,"bytes_used":83324928,"bytes_avail":214128168960,"bytes_total":214211493888,"unknown_pgs_ratio":0.43999999761581421,"write_bytes_sec":693459,"read_op_per_sec":0,"write_op_per_sec":84},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:49:25.192 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:49:25.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:25.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 3124 3108 0.867105 0.796875 0.114393 0.143276 2024-09-16T16:49:25.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:25.327+0000 7f7364991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:25.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:25.338+0000 7f7364991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:25.666 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:25.686 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-16T16:49:24.392903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8913459,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1097,"num_write_kb":9236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1071,"ondisk_log_size":1071,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":81372,"kb_used_data":81372,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209109540,"statfs":{"total":214211493888,"available":214128168960,"internally_reserved":0,"allocated":83324928,"data_stored":83324928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002250"},"pg_stats":[{"pgid":"4.f","version":"36'152","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.204105+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:24.204105+0000","last_peered":"2024-09-16T16:49:24.204105+0000","last_clean":"2024-09-16T16:49:24.204105+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:24.204105+0000","last_undegraded":"2024-09-16T16:49:24.204105+0000","last_fullsized":"2024-09-16T16:49:24.204105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'232","reported_seq":256,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.029286+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:24.029286+0000","last_peered":"2024-09-16T16:49:24.029286+0000","last_clean":"2024-09-16T16:49:24.029286+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:24.029286+0000","last_undegraded":"2024-09-16T16:49:24.029286+0000","last_fullsized":"2024-09-16T16:49:24.029286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.267016+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:24.267016+0000","last_peered":"2024-09-16T16:49:24.267016+0000","last_clean":"2024-09-16T16:49:24.267016+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:24.267016+0000","last_undegraded":"2024-09-16T16:49:24.267016+0000","last_fullsized":"2024-09-16T16:49:24.267016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.126536+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:48:54.126536+0000","last_peered":"2024-09-16T16:48:54.126536+0000","last_clean":"2024-09-16T16:48:54.126536+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:48:54.126536+0000","last_undegraded":"2024-09-16T16:48:54.126536+0000","last_fullsized":"2024-09-16T16:48:54.126536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.112223+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:48:54.112223+0000","last_peered":"2024-09-16T16:48:54.112223+0000","last_clean":"2024-09-16T16:48:54.112223+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:48:54.112223+0000","last_undegraded":"2024-09-16T16:48:54.112223+0000","last_fullsized":"2024-09-16T16:48:54.112223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:22.006677+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:22.006677+0000","last_peered":"2024-09-16T16:49:22.006677+0000","last_clean":"2024-09-16T16:49:22.006677+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:22.006677+0000","last_undegraded":"2024-09-16T16:49:22.006677+0000","last_fullsized":"2024-09-16T16:49:22.006677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.092929+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:48:54.092929+0000","last_peered":"2024-09-16T16:48:54.092929+0000","last_clean":"2024-09-16T16:48:54.092929+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:48:54.092929+0000","last_undegraded":"2024-09-16T16:48:54.092929+0000","last_fullsized":"2024-09-16T16:48:54.092929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:20.980334+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:20.980334+0000","last_peered":"2024-09-16T16:49:20.980334+0000","last_clean":"2024-09-16T16:49:20.980334+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:20.980334+0000","last_undegraded":"2024-09-16T16:49:20.980334+0000","last_fullsized":"2024-09-16T16:49:20.980334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.108326+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:48:54.108326+0000","last_peered":"2024-09-16T16:48:54.108326+0000","last_clean":"2024-09-16T16:48:54.108326+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:48:54.108326+0000","last_undegraded":"2024-09-16T16:48:54.108326+0000","last_fullsized":"2024-09-16T16:48:54.108326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:48:55.066684+0000","last_change":"2024-09-16T16:48:55.066684+0000","last_active":"2024-09-16T16:48:55.066684+0000","last_peered":"2024-09-16T16:48:55.066684+0000","last_clean":"2024-09-16T16:48:55.066684+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:48:55.066684+0000","last_undegraded":"2024-09-16T16:48:55.066684+0000","last_fullsized":"2024-09-16T16:48:55.066684+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T16:48:54.139192+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:48:54.139192+0000","last_peered":"2024-09-16T16:48:54.139192+0000","last_clean":"2024-09-16T16:48:54.139192+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:48:54.139192+0000","last_undegraded":"2024-09-16T16:48:54.139192+0000","last_fullsized":"2024-09-16T16:48:54.139192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1016,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":107105746944,"available":107029340160,"internally_reserved":0,"allocated":76406784,"data_stored":76406784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1016,"ondisk_log_size":1016,"up":15,"acting":15,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214132183040,"internally_reserved":0,"allocated":79310848,"data_stored":79310848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":41664,"kb_used_data":41664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52256064,"statfs":{"total":53552873472,"available":53510209536,"internally_reserved":0,"allocated":42663936,"data_stored":42663936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32672,"kb_used_data":32672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52265056,"statfs":{"total":53552873472,"available":53519417344,"internally_reserved":0,"allocated":33456128,"data_stored":33456128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4608,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293120,"statfs":{"total":53552873472,"available":53548154880,"internally_reserved":0,"allocated":4718592,"data_stored":4718592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2428,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295300,"statfs":{"total":53552873472,"available":53550387200,"internally_reserved":0,"allocated":2486272,"data_stored":2486272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551124480,"internally_reserved":0,"allocated":1748992,"data_stored":1748992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551718400,"internally_reserved":0,"allocated":1155072,"data_stored":1155072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:26.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 3246 3230 0.870068 0.953125 0.059661 0.143327 2024-09-16T16:49:27.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:27.191 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 3369 3353 0.873094 0.960938 0.153918 0.142845 2024-09-16T16:49:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:27.232+0000 7fe8f88a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:27.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:27.242+0000 7fe8f88a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:28.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3464 3448 0.868869 0.742188 0.0547157 0.143362 2024-09-16T16:49:28.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:28.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:28.810+0000 7f96a2688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:28.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:28.821+0000 7f96a2688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:29.102 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:29.124 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-16T16:49:28.393889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25535027,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3126,"num_write_kb":25468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3100,"ondisk_log_size":3100,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":155604,"kb_used_data":155604,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209035308,"statfs":{"total":214211493888,"available":214052155392,"internally_reserved":0,"allocated":159338496,"data_stored":159338496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24944640,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3045,"num_write_kb":24360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002539"},"pg_stats":[{"pgid":"4.f","version":"36'152","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.204105+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:24.204105+0000","last_peered":"2024-09-16T16:49:24.204105+0000","last_clean":"2024-09-16T16:49:24.204105+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:24.204105+0000","last_undegraded":"2024-09-16T16:49:24.204105+0000","last_fullsized":"2024-09-16T16:49:24.204105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'232","reported_seq":256,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.029286+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:24.029286+0000","last_peered":"2024-09-16T16:49:24.029286+0000","last_clean":"2024-09-16T16:49:24.029286+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:24.029286+0000","last_undegraded":"2024-09-16T16:49:24.029286+0000","last_fullsized":"2024-09-16T16:49:24.029286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'229","reported_seq":253,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.378468+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:49:24.378468+0000","last_peered":"2024-09-16T16:49:24.378468+0000","last_clean":"2024-09-16T16:49:24.378468+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:49:24.378468+0000","last_undegraded":"2024-09-16T16:49:24.378468+0000","last_fullsized":"2024-09-16T16:49:24.378468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875968,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":1832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.267016+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:24.267016+0000","last_peered":"2024-09-16T16:49:24.267016+0000","last_clean":"2024-09-16T16:49:24.267016+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:24.267016+0000","last_undegraded":"2024-09-16T16:49:24.267016+0000","last_fullsized":"2024-09-16T16:49:24.267016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.861637+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:49:23.861637+0000","last_peered":"2024-09-16T16:49:23.861637+0000","last_clean":"2024-09-16T16:49:23.861637+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:49:23.861637+0000","last_undegraded":"2024-09-16T16:49:23.861637+0000","last_fullsized":"2024-09-16T16:49:23.861637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.084781+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:49:23.084781+0000","last_peered":"2024-09-16T16:49:23.084781+0000","last_clean":"2024-09-16T16:49:23.084781+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:49:23.084781+0000","last_undegraded":"2024-09-16T16:49:23.084781+0000","last_fullsized":"2024-09-16T16:49:23.084781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.198263+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:49:23.198263+0000","last_peered":"2024-09-16T16:49:23.198263+0000","last_clean":"2024-09-16T16:49:23.198263+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:49:23.198263+0000","last_undegraded":"2024-09-16T16:49:23.198263+0000","last_fullsized":"2024-09-16T16:49:23.198263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.081987+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:49:24.081987+0000","last_peered":"2024-09-16T16:49:24.081987+0000","last_clean":"2024-09-16T16:49:24.081987+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:49:24.081987+0000","last_undegraded":"2024-09-16T16:49:24.081987+0000","last_fullsized":"2024-09-16T16:49:24.081987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.816550+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:49:23.816550+0000","last_peered":"2024-09-16T16:49:23.816550+0000","last_clean":"2024-09-16T16:49:23.816550+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:49:23.816550+0000","last_undegraded":"2024-09-16T16:49:23.816550+0000","last_fullsized":"2024-09-16T16:49:23.816550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.110450+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:49:24.110450+0000","last_peered":"2024-09-16T16:49:24.110450+0000","last_clean":"2024-09-16T16:49:24.110450+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:49:24.110450+0000","last_undegraded":"2024-09-16T16:49:24.110450+0000","last_fullsized":"2024-09-16T16:49:24.110450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:22.006677+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:22.006677+0000","last_peered":"2024-09-16T16:49:22.006677+0000","last_clean":"2024-09-16T16:49:22.006677+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:22.006677+0000","last_undegraded":"2024-09-16T16:49:22.006677+0000","last_fullsized":"2024-09-16T16:49:22.006677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:20.980334+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:20.980334+0000","last_peered":"2024-09-16T16:49:20.980334+0000","last_clean":"2024-09-16T16:49:20.980334+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:20.980334+0000","last_undegraded":"2024-09-16T16:49:20.980334+0000","last_fullsized":"2024-09-16T16:49:20.980334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'208","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.754693+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:49:23.754693+0000","last_peered":"2024-09-16T16:49:23.754693+0000","last_clean":"2024-09-16T16:49:23.754693+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:49:23.754693+0000","last_undegraded":"2024-09-16T16:49:23.754693+0000","last_fullsized":"2024-09-16T16:49:23.754693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.291454+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:49:23.291454+0000","last_peered":"2024-09-16T16:49:23.291454+0000","last_clean":"2024-09-16T16:49:23.291454+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:49:23.291454+0000","last_undegraded":"2024-09-16T16:49:23.291454+0000","last_fullsized":"2024-09-16T16:49:23.291454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'176","reported_seq":200,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.165664+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:49:24.165664+0000","last_peered":"2024-09-16T16:49:24.165664+0000","last_clean":"2024-09-16T16:49:24.165664+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:49:24.165664+0000","last_undegraded":"2024-09-16T16:49:24.165664+0000","last_fullsized":"2024-09-16T16:49:24.165664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.343197+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:49:24.343197+0000","last_peered":"2024-09-16T16:49:24.343197+0000","last_clean":"2024-09-16T16:49:24.343197+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:49:24.343197+0000","last_undegraded":"2024-09-16T16:49:24.343197+0000","last_fullsized":"2024-09-16T16:49:24.343197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":24944640,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3045,"num_write_kb":24360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051532800,"internally_reserved":0,"allocated":159961088,"data_stored":159961088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3045,"ondisk_log_size":3045,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051614720,"internally_reserved":0,"allocated":159879168,"data_stored":159879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":41664,"kb_used_data":41664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52256064,"statfs":{"total":53552873472,"available":53510209536,"internally_reserved":0,"allocated":42663936,"data_stored":42663936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32672,"kb_used_data":32672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52265056,"statfs":{"total":53552873472,"available":53519417344,"internally_reserved":0,"allocated":33456128,"data_stored":33456128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42780,"kb_used_data":42780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52254948,"statfs":{"total":53552873472,"available":53509066752,"internally_reserved":0,"allocated":43806720,"data_stored":43806720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":38488,"kb_used_data":38488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52259240,"statfs":{"total":53552873472,"available":53513461760,"internally_reserved":0,"allocated":39411712,"data_stored":39411712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53513445376,"internally_reserved":0,"allocated":39428096,"data_stored":39428096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53513363456,"internally_reserved":0,"allocated":39510016,"data_stored":39510016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:29.126 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:49:29.126 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:29.126 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:29.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3562 3546 0.865641 0.765625 0.15447 0.14411 2024-09-16T16:49:29.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:29.270+0000 7f5cd2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:29.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:29.282+0000 7f5cd2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:29.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:29.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:29.550 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-16T16:49:28.393889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25535027,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3126,"num_write_kb":25468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3100,"ondisk_log_size":3100,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":155604,"kb_used_data":155604,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209035308,"statfs":{"total":214211493888,"available":214052155392,"internally_reserved":0,"allocated":159338496,"data_stored":159338496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24944640,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3045,"num_write_kb":24360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002539"},"pg_stats":[{"pgid":"4.f","version":"36'152","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.204105+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:24.204105+0000","last_peered":"2024-09-16T16:49:24.204105+0000","last_clean":"2024-09-16T16:49:24.204105+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:24.204105+0000","last_undegraded":"2024-09-16T16:49:24.204105+0000","last_fullsized":"2024-09-16T16:49:24.204105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'232","reported_seq":256,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.029286+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:24.029286+0000","last_peered":"2024-09-16T16:49:24.029286+0000","last_clean":"2024-09-16T16:49:24.029286+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:24.029286+0000","last_undegraded":"2024-09-16T16:49:24.029286+0000","last_fullsized":"2024-09-16T16:49:24.029286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'229","reported_seq":253,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.378468+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:49:24.378468+0000","last_peered":"2024-09-16T16:49:24.378468+0000","last_clean":"2024-09-16T16:49:24.378468+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:49:24.378468+0000","last_undegraded":"2024-09-16T16:49:24.378468+0000","last_fullsized":"2024-09-16T16:49:24.378468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875968,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":1832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.267016+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:24.267016+0000","last_peered":"2024-09-16T16:49:24.267016+0000","last_clean":"2024-09-16T16:49:24.267016+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:24.267016+0000","last_undegraded":"2024-09-16T16:49:24.267016+0000","last_fullsized":"2024-09-16T16:49:24.267016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.861637+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:49:23.861637+0000","last_peered":"2024-09-16T16:49:23.861637+0000","last_clean":"2024-09-16T16:49:23.861637+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:49:23.861637+0000","last_undegraded":"2024-09-16T16:49:23.861637+0000","last_fullsized":"2024-09-16T16:49:23.861637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.084781+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:49:23.084781+0000","last_peered":"2024-09-16T16:49:23.084781+0000","last_clean":"2024-09-16T16:49:23.084781+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:49:23.084781+0000","last_undegraded":"2024-09-16T16:49:23.084781+0000","last_fullsized":"2024-09-16T16:49:23.084781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.198263+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:49:23.198263+0000","last_peered":"2024-09-16T16:49:23.198263+0000","last_clean":"2024-09-16T16:49:23.198263+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:49:23.198263+0000","last_undegraded":"2024-09-16T16:49:23.198263+0000","last_fullsized":"2024-09-16T16:49:23.198263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.081987+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:49:24.081987+0000","last_peered":"2024-09-16T16:49:24.081987+0000","last_clean":"2024-09-16T16:49:24.081987+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:49:24.081987+0000","last_undegraded":"2024-09-16T16:49:24.081987+0000","last_fullsized":"2024-09-16T16:49:24.081987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.816550+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:49:23.816550+0000","last_peered":"2024-09-16T16:49:23.816550+0000","last_clean":"2024-09-16T16:49:23.816550+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:49:23.816550+0000","last_undegraded":"2024-09-16T16:49:23.816550+0000","last_fullsized":"2024-09-16T16:49:23.816550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.110450+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:49:24.110450+0000","last_peered":"2024-09-16T16:49:24.110450+0000","last_clean":"2024-09-16T16:49:24.110450+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:49:24.110450+0000","last_undegraded":"2024-09-16T16:49:24.110450+0000","last_fullsized":"2024-09-16T16:49:24.110450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:22.006677+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:22.006677+0000","last_peered":"2024-09-16T16:49:22.006677+0000","last_clean":"2024-09-16T16:49:22.006677+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:22.006677+0000","last_undegraded":"2024-09-16T16:49:22.006677+0000","last_fullsized":"2024-09-16T16:49:22.006677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:20.980334+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:20.980334+0000","last_peered":"2024-09-16T16:49:20.980334+0000","last_clean":"2024-09-16T16:49:20.980334+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:20.980334+0000","last_undegraded":"2024-09-16T16:49:20.980334+0000","last_fullsized":"2024-09-16T16:49:20.980334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'208","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.754693+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:49:23.754693+0000","last_peered":"2024-09-16T16:49:23.754693+0000","last_clean":"2024-09-16T16:49:23.754693+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:49:23.754693+0000","last_undegraded":"2024-09-16T16:49:23.754693+0000","last_fullsized":"2024-09-16T16:49:23.754693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.291454+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:49:23.291454+0000","last_peered":"2024-09-16T16:49:23.291454+0000","last_clean":"2024-09-16T16:49:23.291454+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:49:23.291454+0000","last_undegraded":"2024-09-16T16:49:23.291454+0000","last_fullsized":"2024-09-16T16:49:23.291454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'176","reported_seq":200,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.165664+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:49:24.165664+0000","last_peered":"2024-09-16T16:49:24.165664+0000","last_clean":"2024-09-16T16:49:24.165664+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:49:24.165664+0000","last_undegraded":"2024-09-16T16:49:24.165664+0000","last_fullsized":"2024-09-16T16:49:24.165664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.343197+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:49:24.343197+0000","last_peered":"2024-09-16T16:49:24.343197+0000","last_clean":"2024-09-16T16:49:24.343197+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:49:24.343197+0000","last_undegraded":"2024-09-16T16:49:24.343197+0000","last_fullsized":"2024-09-16T16:49:24.343197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":24944640,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3045,"num_write_kb":24360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051532800,"internally_reserved":0,"allocated":159961088,"data_stored":159961088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3045,"ondisk_log_size":3045,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051614720,"internally_reserved":0,"allocated":159879168,"data_stored":159879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":41664,"kb_used_data":41664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52256064,"statfs":{"total":53552873472,"available":53510209536,"internally_reserved":0,"allocated":42663936,"data_stored":42663936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32672,"kb_used_data":32672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52265056,"statfs":{"total":53552873472,"available":53519417344,"internally_reserved":0,"allocated":33456128,"data_stored":33456128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42780,"kb_used_data":42780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52254948,"statfs":{"total":53552873472,"available":53509066752,"internally_reserved":0,"allocated":43806720,"data_stored":43806720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":38488,"kb_used_data":38488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52259240,"statfs":{"total":53552873472,"available":53513461760,"internally_reserved":0,"allocated":39411712,"data_stored":39411712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53513445376,"internally_reserved":0,"allocated":39428096,"data_stored":39428096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53513363456,"internally_reserved":0,"allocated":39510016,"data_stored":39510016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:29.654+0000 7efffcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:29.661+0000 7efffcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:30.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3656 3640 0.861661 0.734375 0.0868213 0.144708 2024-09-16T16:49:31.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3766 3750 0.861591 0.859375 0.171569 0.144699 2024-09-16T16:49:31.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:32.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:32.066+0000 7f72ad4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:32.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:32.076+0000 7f72ad4ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:32.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 3863 3847 0.858624 0.757812 0.127754 0.145233 2024-09-16T16:49:33.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 3931 3915 0.849529 0.53125 0.0875509 0.146714 2024-09-16T16:49:34.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 4056 4040 0.85296 0.976562 0.243083 0.146174 2024-09-16T16:49:34.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:34.551 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:34.552 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:34.552 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:49:34.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:49:34.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:34.577+0000 7fc0d7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:34.589+0000 7fc0d7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:34.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:34.700+0000 7fc1dd911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:34.715+0000 7fc1dd911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:34.748 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:34.749 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:34.752 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:34.753 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:34.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:49:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:34.963+0000 7fb3d6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:34.975+0000 7fb3d6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:35.101 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:35.106 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:35.106 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:35.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:49:35.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 4160 4144 0.851893 0.8125 0.271252 0.146264 2024-09-16T16:49:35.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:35.241+0000 7f060bb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:35.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:35.256+0000 7f060bb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:35.348 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:35.349 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:35.352 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:35.353 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:35.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:49:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:35.542+0000 7fa9f1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:35.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:35.556+0000 7fa9f1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:35.621 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:35.621 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:35.621 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:35.621 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:35.621 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:35.621 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:35.622 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:35.622 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:35.622 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:35.622 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:35.622 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:35.622 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:35.625 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:35.626 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:36.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 4280 4264 0.854086 0.9375 0.295331 0.146056 2024-09-16T16:49:37.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:37.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:49:37.193118+0000 min lat: 0.0205383 max lat: 0.728974 avg lat: 0.147038 2024-09-16T16:49:37.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:49:37.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4352 4336 0.846795 0.5625 0.303113 0.147038 2024-09-16T16:49:37.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:37.297+0000 7f451c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:37.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:37.305+0000 7f451c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:38.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4465 4449 0.847671 0.882812 0.147603 0.147245 2024-09-16T16:49:39.192 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4570 4554 0.847018 0.820312 0.0499607 0.147218 2024-09-16T16:49:39.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:39.972+0000 7f6dff246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:39.981+0000 7f6dff246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:40.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4682 4666 0.847667 0.875 0.122007 0.147113 2024-09-16T16:49:40.627 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:40.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:40.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:40.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:40.781+0000 7f4bd1efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:40.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:40.797+0000 7f4bd1efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:41.032 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:41.032 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-16T16:49:40.396112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25535027,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3126,"num_write_kb":25468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3100,"ondisk_log_size":3100,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":155604,"kb_used_data":155604,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209035308,"statfs":{"total":214211493888,"available":214052155392,"internally_reserved":0,"allocated":159338496,"data_stored":159338496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002223"},"pg_stats":[{"pgid":"4.f","version":"36'152","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.204105+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:24.204105+0000","last_peered":"2024-09-16T16:49:24.204105+0000","last_clean":"2024-09-16T16:49:24.204105+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:24.204105+0000","last_undegraded":"2024-09-16T16:49:24.204105+0000","last_fullsized":"2024-09-16T16:49:24.204105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'232","reported_seq":256,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.029286+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:24.029286+0000","last_peered":"2024-09-16T16:49:24.029286+0000","last_clean":"2024-09-16T16:49:24.029286+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:24.029286+0000","last_undegraded":"2024-09-16T16:49:24.029286+0000","last_fullsized":"2024-09-16T16:49:24.029286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'229","reported_seq":253,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.378468+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:49:24.378468+0000","last_peered":"2024-09-16T16:49:24.378468+0000","last_clean":"2024-09-16T16:49:24.378468+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:49:24.378468+0000","last_undegraded":"2024-09-16T16:49:24.378468+0000","last_fullsized":"2024-09-16T16:49:24.378468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875968,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":1832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.267016+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:24.267016+0000","last_peered":"2024-09-16T16:49:24.267016+0000","last_clean":"2024-09-16T16:49:24.267016+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:24.267016+0000","last_undegraded":"2024-09-16T16:49:24.267016+0000","last_fullsized":"2024-09-16T16:49:24.267016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.861637+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:49:23.861637+0000","last_peered":"2024-09-16T16:49:23.861637+0000","last_clean":"2024-09-16T16:49:23.861637+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:49:23.861637+0000","last_undegraded":"2024-09-16T16:49:23.861637+0000","last_fullsized":"2024-09-16T16:49:23.861637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.084781+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:49:23.084781+0000","last_peered":"2024-09-16T16:49:23.084781+0000","last_clean":"2024-09-16T16:49:23.084781+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:49:23.084781+0000","last_undegraded":"2024-09-16T16:49:23.084781+0000","last_fullsized":"2024-09-16T16:49:23.084781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.198263+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:49:23.198263+0000","last_peered":"2024-09-16T16:49:23.198263+0000","last_clean":"2024-09-16T16:49:23.198263+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:49:23.198263+0000","last_undegraded":"2024-09-16T16:49:23.198263+0000","last_fullsized":"2024-09-16T16:49:23.198263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.081987+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:49:24.081987+0000","last_peered":"2024-09-16T16:49:24.081987+0000","last_clean":"2024-09-16T16:49:24.081987+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:49:24.081987+0000","last_undegraded":"2024-09-16T16:49:24.081987+0000","last_fullsized":"2024-09-16T16:49:24.081987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.816550+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:49:23.816550+0000","last_peered":"2024-09-16T16:49:23.816550+0000","last_clean":"2024-09-16T16:49:23.816550+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:49:23.816550+0000","last_undegraded":"2024-09-16T16:49:23.816550+0000","last_fullsized":"2024-09-16T16:49:23.816550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.110450+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:49:24.110450+0000","last_peered":"2024-09-16T16:49:24.110450+0000","last_clean":"2024-09-16T16:49:24.110450+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:49:24.110450+0000","last_undegraded":"2024-09-16T16:49:24.110450+0000","last_fullsized":"2024-09-16T16:49:24.110450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:22.006677+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:22.006677+0000","last_peered":"2024-09-16T16:49:22.006677+0000","last_clean":"2024-09-16T16:49:22.006677+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:22.006677+0000","last_undegraded":"2024-09-16T16:49:22.006677+0000","last_fullsized":"2024-09-16T16:49:22.006677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:20.980334+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:20.980334+0000","last_peered":"2024-09-16T16:49:20.980334+0000","last_clean":"2024-09-16T16:49:20.980334+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:20.980334+0000","last_undegraded":"2024-09-16T16:49:20.980334+0000","last_fullsized":"2024-09-16T16:49:20.980334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'208","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.754693+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:49:23.754693+0000","last_peered":"2024-09-16T16:49:23.754693+0000","last_clean":"2024-09-16T16:49:23.754693+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:49:23.754693+0000","last_undegraded":"2024-09-16T16:49:23.754693+0000","last_fullsized":"2024-09-16T16:49:23.754693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.291454+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:49:23.291454+0000","last_peered":"2024-09-16T16:49:23.291454+0000","last_clean":"2024-09-16T16:49:23.291454+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:49:23.291454+0000","last_undegraded":"2024-09-16T16:49:23.291454+0000","last_fullsized":"2024-09-16T16:49:23.291454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'176","reported_seq":200,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.165664+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:49:24.165664+0000","last_peered":"2024-09-16T16:49:24.165664+0000","last_clean":"2024-09-16T16:49:24.165664+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:49:24.165664+0000","last_undegraded":"2024-09-16T16:49:24.165664+0000","last_fullsized":"2024-09-16T16:49:24.165664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.343197+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:49:24.343197+0000","last_peered":"2024-09-16T16:49:24.343197+0000","last_clean":"2024-09-16T16:49:24.343197+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:49:24.343197+0000","last_undegraded":"2024-09-16T16:49:24.343197+0000","last_fullsized":"2024-09-16T16:49:24.343197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":24944640,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3045,"num_write_kb":24360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051532800,"internally_reserved":0,"allocated":159961088,"data_stored":159961088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3045,"ondisk_log_size":3045,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051614720,"internally_reserved":0,"allocated":159879168,"data_stored":159879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":41664,"kb_used_data":41664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52256064,"statfs":{"total":53552873472,"available":53510209536,"internally_reserved":0,"allocated":42663936,"data_stored":42663936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32672,"kb_used_data":32672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52265056,"statfs":{"total":53552873472,"available":53519417344,"internally_reserved":0,"allocated":33456128,"data_stored":33456128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42780,"kb_used_data":42780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52254948,"statfs":{"total":53552873472,"available":53509066752,"internally_reserved":0,"allocated":43806720,"data_stored":43806720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":38488,"kb_used_data":38488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52259240,"statfs":{"total":53552873472,"available":53513461760,"internally_reserved":0,"allocated":39411712,"data_stored":39411712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53513445376,"internally_reserved":0,"allocated":39428096,"data_stored":39428096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53513363456,"internally_reserved":0,"allocated":39510016,"data_stored":39510016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:41.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 15 4782 4767 0.846333 0.789062 0.110265 0.147202 2024-09-16T16:49:42.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 4913 4897 0.850093 1.01562 0.0710251 0.146768 2024-09-16T16:49:42.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:42.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:42.487+0000 7f5956391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:42.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:42.495+0000 7f5956391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:43.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 5019 5003 0.849614 0.828125 0.11405 0.1468 2024-09-16T16:49:44.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 16 5112 5096 0.846994 0.726562 0.0970446 0.14731 2024-09-16T16:49:44.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:45.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:45.036+0000 7fb36aafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:45.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:45.045+0000 7fb36aafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:45.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 5218 5202 0.846599 0.828125 0.0972517 0.147331 2024-09-16T16:49:46.051 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:46.051 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:46.051 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:49:46.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:49:46.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 5329 5313 0.847018 0.867188 0.128039 0.147353 2024-09-16T16:49:46.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.222+0000 7f0e0ae63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.234+0000 7f0e0ae63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:46.339 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:46.340 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:46.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:49:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.460+0000 7f1725311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.472+0000 7f1725311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:46.588 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:46.588 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:46.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:49:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.725+0000 7fad5af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.742+0000 7fad5af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:46.789 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:46.789 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:46.789 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:49:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.953+0000 7fef9d948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:46.964+0000 7fef9d948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:47.049 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:47.050 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:47.050 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:47.050 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:47.053 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:47.053 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:47.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 5411 5395 0.842889 0.640625 0.311772 0.147934 2024-09-16T16:49:47.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:47.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:47.472+0000 7f02da311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:47.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:47.480+0000 7f02da311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:48.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5497 5481 0.839534 0.671875 0.117853 0.148458 2024-09-16T16:49:49.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 16 5607 5591 0.839914 0.859375 0.163636 0.148682 2024-09-16T16:49:49.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:49.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:49.821+0000 7f2beb591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:49.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:49.828+0000 7f2beb591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:50.193 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 5695 5679 0.837037 0.6875 0.210582 0.148894 2024-09-16T16:49:51.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 5804 5788 0.837305 0.851562 0.163975 0.149051 2024-09-16T16:49:52.054 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:52.054 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:52.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:49:52.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:52.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:52.171+0000 7f18c34e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:52.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:52.181+0000 7f18c34e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:52.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 5903 5887 0.836142 0.773438 0.199215 0.149154 2024-09-16T16:49:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:52.252+0000 7fc92c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:52.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:52.260+0000 7fc92c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:52.408 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:49:52.409 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:49:52.425 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2024-09-16T16:49:52.398439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25535027,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3126,"num_write_kb":25468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3100,"ondisk_log_size":3100,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":155604,"kb_used_data":155604,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209035308,"statfs":{"total":214211493888,"available":214052155392,"internally_reserved":0,"allocated":159338496,"data_stored":159338496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002326"},"pg_stats":[{"pgid":"4.f","version":"36'152","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.204105+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:24.204105+0000","last_peered":"2024-09-16T16:49:24.204105+0000","last_clean":"2024-09-16T16:49:24.204105+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:24.204105+0000","last_undegraded":"2024-09-16T16:49:24.204105+0000","last_fullsized":"2024-09-16T16:49:24.204105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'232","reported_seq":256,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.029286+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:24.029286+0000","last_peered":"2024-09-16T16:49:24.029286+0000","last_clean":"2024-09-16T16:49:24.029286+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:24.029286+0000","last_undegraded":"2024-09-16T16:49:24.029286+0000","last_fullsized":"2024-09-16T16:49:24.029286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'229","reported_seq":253,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.378468+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:49:24.378468+0000","last_peered":"2024-09-16T16:49:24.378468+0000","last_clean":"2024-09-16T16:49:24.378468+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:49:24.378468+0000","last_undegraded":"2024-09-16T16:49:24.378468+0000","last_fullsized":"2024-09-16T16:49:24.378468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875968,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":1832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.267016+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:24.267016+0000","last_peered":"2024-09-16T16:49:24.267016+0000","last_clean":"2024-09-16T16:49:24.267016+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:24.267016+0000","last_undegraded":"2024-09-16T16:49:24.267016+0000","last_fullsized":"2024-09-16T16:49:24.267016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.861637+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:49:23.861637+0000","last_peered":"2024-09-16T16:49:23.861637+0000","last_clean":"2024-09-16T16:49:23.861637+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:49:23.861637+0000","last_undegraded":"2024-09-16T16:49:23.861637+0000","last_fullsized":"2024-09-16T16:49:23.861637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.084781+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:49:23.084781+0000","last_peered":"2024-09-16T16:49:23.084781+0000","last_clean":"2024-09-16T16:49:23.084781+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:49:23.084781+0000","last_undegraded":"2024-09-16T16:49:23.084781+0000","last_fullsized":"2024-09-16T16:49:23.084781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.198263+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:49:23.198263+0000","last_peered":"2024-09-16T16:49:23.198263+0000","last_clean":"2024-09-16T16:49:23.198263+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:49:23.198263+0000","last_undegraded":"2024-09-16T16:49:23.198263+0000","last_fullsized":"2024-09-16T16:49:23.198263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.081987+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:49:24.081987+0000","last_peered":"2024-09-16T16:49:24.081987+0000","last_clean":"2024-09-16T16:49:24.081987+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:49:24.081987+0000","last_undegraded":"2024-09-16T16:49:24.081987+0000","last_fullsized":"2024-09-16T16:49:24.081987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'192","reported_seq":216,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.816550+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:49:23.816550+0000","last_peered":"2024-09-16T16:49:23.816550+0000","last_clean":"2024-09-16T16:49:23.816550+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:49:23.816550+0000","last_undegraded":"2024-09-16T16:49:23.816550+0000","last_fullsized":"2024-09-16T16:49:23.816550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'144","reported_seq":168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.110450+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:49:24.110450+0000","last_peered":"2024-09-16T16:49:24.110450+0000","last_clean":"2024-09-16T16:49:24.110450+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:49:24.110450+0000","last_undegraded":"2024-09-16T16:49:24.110450+0000","last_fullsized":"2024-09-16T16:49:24.110450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'184","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:22.006677+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:22.006677+0000","last_peered":"2024-09-16T16:49:22.006677+0000","last_clean":"2024-09-16T16:49:22.006677+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:22.006677+0000","last_undegraded":"2024-09-16T16:49:22.006677+0000","last_fullsized":"2024-09-16T16:49:22.006677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'224","reported_seq":248,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:20.980334+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:20.980334+0000","last_peered":"2024-09-16T16:49:20.980334+0000","last_clean":"2024-09-16T16:49:20.980334+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:20.980334+0000","last_undegraded":"2024-09-16T16:49:20.980334+0000","last_fullsized":"2024-09-16T16:49:20.980334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'208","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.754693+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:49:23.754693+0000","last_peered":"2024-09-16T16:49:23.754693+0000","last_clean":"2024-09-16T16:49:23.754693+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:49:23.754693+0000","last_undegraded":"2024-09-16T16:49:23.754693+0000","last_fullsized":"2024-09-16T16:49:23.754693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:23.291454+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:49:23.291454+0000","last_peered":"2024-09-16T16:49:23.291454+0000","last_clean":"2024-09-16T16:49:23.291454+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:49:23.291454+0000","last_undegraded":"2024-09-16T16:49:23.291454+0000","last_fullsized":"2024-09-16T16:49:23.291454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'176","reported_seq":200,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.165664+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:49:24.165664+0000","last_peered":"2024-09-16T16:49:24.165664+0000","last_clean":"2024-09-16T16:49:24.165664+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:49:24.165664+0000","last_undegraded":"2024-09-16T16:49:24.165664+0000","last_fullsized":"2024-09-16T16:49:24.165664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'168","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:24.343197+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:49:24.343197+0000","last_peered":"2024-09-16T16:49:24.343197+0000","last_clean":"2024-09-16T16:49:24.343197+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:49:24.343197+0000","last_undegraded":"2024-09-16T16:49:24.343197+0000","last_fullsized":"2024-09-16T16:49:24.343197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":24944640,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3045,"num_write_kb":24360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051532800,"internally_reserved":0,"allocated":159961088,"data_stored":159961088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3045,"ondisk_log_size":3045,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214051614720,"internally_reserved":0,"allocated":159879168,"data_stored":159879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":41664,"kb_used_data":41664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52256064,"statfs":{"total":53552873472,"available":53510209536,"internally_reserved":0,"allocated":42663936,"data_stored":42663936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32672,"kb_used_data":32672,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52265056,"statfs":{"total":53552873472,"available":53519417344,"internally_reserved":0,"allocated":33456128,"data_stored":33456128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42780,"kb_used_data":42780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52254948,"statfs":{"total":53552873472,"available":53509066752,"internally_reserved":0,"allocated":43806720,"data_stored":43806720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705815,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":38488,"kb_used_data":38488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52259240,"statfs":{"total":53552873472,"available":53513461760,"internally_reserved":0,"allocated":39411712,"data_stored":39411712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53513445376,"internally_reserved":0,"allocated":39428096,"data_stored":39428096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53513363456,"internally_reserved":0,"allocated":39510016,"data_stored":39510016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53508829184,"internally_reserved":0,"allocated":44044288,"data_stored":44044288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53519335424,"internally_reserved":0,"allocated":33538048,"data_stored":33538048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53510004736,"internally_reserved":0,"allocated":42868736,"data_stored":42868736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:49:53.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 6022 6006 0.837811 0.929688 0.0888874 0.149021 2024-09-16T16:49:54.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 6140 6124 0.839284 0.921875 0.0774275 0.148801 2024-09-16T16:49:54.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:54.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:54.807+0000 7f8ffe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:54.819+0000 7f8ffe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:55.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 6240 6224 0.838283 0.78125 0.109488 0.148916 2024-09-16T16:49:56.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 6330 6314 0.835991 0.703125 0.0879985 0.149316 2024-09-16T16:49:57.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:49:57.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:49:57.195027+0000 min lat: 0.0205383 max lat: 0.728974 avg lat: 0.149509 2024-09-16T16:49:57.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:49:57.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 6428 6412 0.834817 0.765625 0.0741975 0.149509 2024-09-16T16:49:57.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:57.311+0000 7ff530591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:57.324+0000 7ff530591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.427 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:49:57.427 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:49:57.427 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:49:57.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:49:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:57.578+0000 7f3601697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:57.592+0000 7f3601697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.614 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:57.614 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:57.614 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:57.614 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:57.614 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:57.614 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:57.614 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:57.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:57.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:57.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:57.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:57.615 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:57.619 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:57.620 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:57.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:49:57.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:57.760+0000 7fbecec7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:57.773+0000 7fbecec7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:57.838 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:57.838 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:57.839 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:57.843 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:57.843 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:57.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:49:58.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:58.022+0000 7fbcd2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:58.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:58.035+0000 7fbcd2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:58.092 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:58.093 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:58.098 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:58.098 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:58.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:49:58.194 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 6539 6523 0.835345 0.867188 0.11979 0.149414 2024-09-16T16:49:58.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:58.228+0000 7f9f12ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:58.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:58.239+0000 7f9f12ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:49:58.265 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:49:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:49:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:49:58.266 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:49:58.269 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:49:58.269 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:49:59.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6646 6630 0.835353 0.835938 0.0723584 0.14928 2024-09-16T16:49:59.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:49:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:59.931+0000 7f1ea7b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:49:59.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:49:59.940+0000 7f1ea7b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:00.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 6734 6718 0.833005 0.6875 0.251018 0.149821 2024-09-16T16:50:01.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 15 6841 6826 0.833172 0.84375 0.207466 0.149809 2024-09-16T16:50:02.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 6946 6930 0.832852 0.8125 0.147719 0.149688 2024-09-16T16:50:02.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:02.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:02.545+0000 7fd8c4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:02.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:02.554+0000 7fd8c4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:03.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 7040 7024 0.831359 0.734375 0.280966 0.150098 2024-09-16T16:50:03.270 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:03.270 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:03.270 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:03.395+0000 7ff7cb8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:03.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:03.405+0000 7ff7cb8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:03.610 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:03.610 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-16T16:50:02.400421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":51020339,"num_objects":774,"num_object_clones":0,"num_object_copies":2322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6237,"num_write_kb":50356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6211,"ondisk_log_size":6211,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":312228,"kb_used_data":312228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208878684,"statfs":{"total":214211493888,"available":213891772416,"internally_reserved":0,"allocated":319721472,"data_stored":319721472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25485312,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3111,"num_write_kb":24888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002355"},"pg_stats":[{"pgid":"4.f","version":"36'376","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.266353+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:53.266353+0000","last_peered":"2024-09-16T16:49:53.266353+0000","last_clean":"2024-09-16T16:49:53.266353+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:53.266353+0000","last_undegraded":"2024-09-16T16:49:53.266353+0000","last_fullsized":"2024-09-16T16:49:53.266353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.186428+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:54.186428+0000","last_peered":"2024-09-16T16:49:54.186428+0000","last_clean":"2024-09-16T16:49:54.186428+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:54.186428+0000","last_undegraded":"2024-09-16T16:49:54.186428+0000","last_fullsized":"2024-09-16T16:49:54.186428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'400","reported_seq":424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.152830+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:49:54.152830+0000","last_peered":"2024-09-16T16:49:54.152830+0000","last_clean":"2024-09-16T16:49:54.152830+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:49:54.152830+0000","last_undegraded":"2024-09-16T16:49:54.152830+0000","last_fullsized":"2024-09-16T16:49:54.152830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'432","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.929201+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:53.929201+0000","last_peered":"2024-09-16T16:49:53.929201+0000","last_clean":"2024-09-16T16:49:53.929201+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:53.929201+0000","last_undegraded":"2024-09-16T16:49:53.929201+0000","last_fullsized":"2024-09-16T16:49:53.929201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'380","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.381862+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:49:54.381862+0000","last_peered":"2024-09-16T16:49:54.381862+0000","last_clean":"2024-09-16T16:49:54.381862+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:49:54.381862+0000","last_undegraded":"2024-09-16T16:49:54.381862+0000","last_fullsized":"2024-09-16T16:49:54.381862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3112960,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'344","reported_seq":368,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.064076+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:49:54.064076+0000","last_peered":"2024-09-16T16:49:54.064076+0000","last_clean":"2024-09-16T16:49:54.064076+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:49:54.064076+0000","last_undegraded":"2024-09-16T16:49:54.064076+0000","last_fullsized":"2024-09-16T16:49:54.064076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'368","reported_seq":392,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:50.554359+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:49:50.554359+0000","last_peered":"2024-09-16T16:49:50.554359+0000","last_clean":"2024-09-16T16:49:50.554359+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:49:50.554359+0000","last_undegraded":"2024-09-16T16:49:50.554359+0000","last_fullsized":"2024-09-16T16:49:50.554359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'424","reported_seq":448,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.324824+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:49:53.324824+0000","last_peered":"2024-09-16T16:49:53.324824+0000","last_clean":"2024-09-16T16:49:53.324824+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:49:53.324824+0000","last_undegraded":"2024-09-16T16:49:53.324824+0000","last_fullsized":"2024-09-16T16:49:53.324824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'352","reported_seq":376,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.748297+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:49:53.748297+0000","last_peered":"2024-09-16T16:49:53.748297+0000","last_clean":"2024-09-16T16:49:53.748297+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:49:53.748297+0000","last_undegraded":"2024-09-16T16:49:53.748297+0000","last_fullsized":"2024-09-16T16:49:53.748297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'288","reported_seq":312,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.103615+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:49:53.103615+0000","last_peered":"2024-09-16T16:49:53.103615+0000","last_clean":"2024-09-16T16:49:53.103615+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:49:53.103615+0000","last_undegraded":"2024-09-16T16:49:53.103615+0000","last_fullsized":"2024-09-16T16:49:53.103615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'416","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:52.944559+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:52.944559+0000","last_peered":"2024-09-16T16:49:52.944559+0000","last_clean":"2024-09-16T16:49:52.944559+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:52.944559+0000","last_undegraded":"2024-09-16T16:49:52.944559+0000","last_fullsized":"2024-09-16T16:49:52.944559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'400","reported_seq":424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.337509+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:54.337509+0000","last_peered":"2024-09-16T16:49:54.337509+0000","last_clean":"2024-09-16T16:49:54.337509+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:54.337509+0000","last_undegraded":"2024-09-16T16:49:54.337509+0000","last_fullsized":"2024-09-16T16:49:54.337509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.814402+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:49:53.814402+0000","last_peered":"2024-09-16T16:49:53.814402+0000","last_clean":"2024-09-16T16:49:53.814402+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:49:53.814402+0000","last_undegraded":"2024-09-16T16:49:53.814402+0000","last_fullsized":"2024-09-16T16:49:53.814402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'392","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.003987+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:49:54.003987+0000","last_peered":"2024-09-16T16:49:54.003987+0000","last_clean":"2024-09-16T16:49:54.003987+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:49:54.003987+0000","last_undegraded":"2024-09-16T16:49:54.003987+0000","last_fullsized":"2024-09-16T16:49:54.003987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'384","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.157763+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:49:53.157763+0000","last_peered":"2024-09-16T16:49:53.157763+0000","last_clean":"2024-09-16T16:49:53.157763+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:49:53.157763+0000","last_undegraded":"2024-09-16T16:49:53.157763+0000","last_fullsized":"2024-09-16T16:49:53.157763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'384","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.268316+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:49:54.268316+0000","last_peered":"2024-09-16T16:49:54.268316+0000","last_clean":"2024-09-16T16:49:54.268316+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:49:54.268316+0000","last_undegraded":"2024-09-16T16:49:54.268316+0000","last_fullsized":"2024-09-16T16:49:54.268316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":50429952,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6156,"num_write_kb":49248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213891518464,"internally_reserved":0,"allocated":319975424,"data_stored":319975424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6156,"ondisk_log_size":6156,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213891526656,"internally_reserved":0,"allocated":319967232,"data_stored":319967232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":84136,"kb_used_data":84136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213592,"statfs":{"total":53552873472,"available":53466718208,"internally_reserved":0,"allocated":86155264,"data_stored":86155264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65068,"kb_used_data":65068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232660,"statfs":{"total":53552873472,"available":53486243840,"internally_reserved":0,"allocated":66629632,"data_stored":66629632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":84972,"kb_used_data":84972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52212756,"statfs":{"total":53552873472,"available":53465862144,"internally_reserved":0,"allocated":87011328,"data_stored":87011328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705845,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":78052,"kb_used_data":78052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52219676,"statfs":{"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53465772032,"internally_reserved":0,"allocated":87101440,"data_stored":87101440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53486161920,"internally_reserved":0,"allocated":66711552,"data_stored":66711552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53465772032,"internally_reserved":0,"allocated":87101440,"data_stored":87101440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53486153728,"internally_reserved":0,"allocated":66719744,"data_stored":66719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:04.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 7145 7129 0.831193 0.820312 0.18138 0.15018 2024-09-16T16:50:04.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:05.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:05.048+0000 7f6d54311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:05.057+0000 7f6d54311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:05.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 7248 7232 0.830802 0.804688 0.301466 0.150223 2024-09-16T16:50:06.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 15 7368 7353 0.83246 0.945312 0.059923 0.149956 2024-09-16T16:50:07.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 7440 7424 0.828492 0.554688 0.465202 0.150521 2024-09-16T16:50:07.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:07.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:07.431+0000 7f067847f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:07.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:07.441+0000 7f067847f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:08.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 7555 7539 0.829475 0.898438 0.179659 0.150577 2024-09-16T16:50:08.628 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:08.628 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:08.628 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:50:08.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:50:08.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:08.749+0000 7fc98d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:08.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:08.763+0000 7fc98d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:08.862 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:08.862 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:08.866 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:08.866 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:08.866 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:50:09.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:09.006+0000 7f4fae911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:09.018+0000 7f4fae911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.096 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:09.100 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:09.100 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:09.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:50:09.195 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7652 7636 0.828479 0.757812 0.228339 0.150613 2024-09-16T16:50:09.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:09.213+0000 7f5f70074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:09.224+0000 7f5f70074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:09.299 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:09.302 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:09.303 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:09.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:50:09.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:09.416+0000 7f8ba4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:09.429+0000 7f8ba4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:09.472 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:09.473 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:09.476 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:09.477 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:09.889 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:10.024+0000 7efcd7ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:10.032+0000 7efcd7ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:10.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 7742 7726 0.826761 0.703125 0.249939 0.150865 2024-09-16T16:50:11.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 7823 7807 0.824139 0.632812 0.103231 0.151472 2024-09-16T16:50:12.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 7928 7912 0.824087 0.820312 0.213746 0.151504 2024-09-16T16:50:12.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:12.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:12.474+0000 7fe01bd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:12.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:12.482+0000 7fe01bd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:13.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 8025 8009 0.823214 0.757812 0.159529 0.15163 2024-09-16T16:50:14.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 8131 8115 0.823277 0.828125 0.119365 0.151597 2024-09-16T16:50:14.478 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:14.478 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:14.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:14.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:14.632+0000 7f2187aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:14.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:14.643+0000 7f2187aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:14.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:14.934 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:14.934 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:14.958 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-09-16T16:50:14.402764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":51020339,"num_objects":774,"num_object_clones":0,"num_object_copies":2322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6237,"num_write_kb":50356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6211,"ondisk_log_size":6211,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":312228,"kb_used_data":312228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208878684,"statfs":{"total":214211493888,"available":213891772416,"internally_reserved":0,"allocated":319721472,"data_stored":319721472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002343"},"pg_stats":[{"pgid":"4.f","version":"36'376","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.266353+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:53.266353+0000","last_peered":"2024-09-16T16:49:53.266353+0000","last_clean":"2024-09-16T16:49:53.266353+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:53.266353+0000","last_undegraded":"2024-09-16T16:49:53.266353+0000","last_fullsized":"2024-09-16T16:49:53.266353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.186428+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:54.186428+0000","last_peered":"2024-09-16T16:49:54.186428+0000","last_clean":"2024-09-16T16:49:54.186428+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:54.186428+0000","last_undegraded":"2024-09-16T16:49:54.186428+0000","last_fullsized":"2024-09-16T16:49:54.186428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'400","reported_seq":424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.152830+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:49:54.152830+0000","last_peered":"2024-09-16T16:49:54.152830+0000","last_clean":"2024-09-16T16:49:54.152830+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:49:54.152830+0000","last_undegraded":"2024-09-16T16:49:54.152830+0000","last_fullsized":"2024-09-16T16:49:54.152830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'432","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.929201+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:53.929201+0000","last_peered":"2024-09-16T16:49:53.929201+0000","last_clean":"2024-09-16T16:49:53.929201+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:53.929201+0000","last_undegraded":"2024-09-16T16:49:53.929201+0000","last_fullsized":"2024-09-16T16:49:53.929201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'380","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.381862+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:49:54.381862+0000","last_peered":"2024-09-16T16:49:54.381862+0000","last_clean":"2024-09-16T16:49:54.381862+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:49:54.381862+0000","last_undegraded":"2024-09-16T16:49:54.381862+0000","last_fullsized":"2024-09-16T16:49:54.381862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3112960,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'344","reported_seq":368,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.064076+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:49:54.064076+0000","last_peered":"2024-09-16T16:49:54.064076+0000","last_clean":"2024-09-16T16:49:54.064076+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:49:54.064076+0000","last_undegraded":"2024-09-16T16:49:54.064076+0000","last_fullsized":"2024-09-16T16:49:54.064076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'368","reported_seq":392,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:50.554359+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:49:50.554359+0000","last_peered":"2024-09-16T16:49:50.554359+0000","last_clean":"2024-09-16T16:49:50.554359+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:49:50.554359+0000","last_undegraded":"2024-09-16T16:49:50.554359+0000","last_fullsized":"2024-09-16T16:49:50.554359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'424","reported_seq":448,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.324824+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:49:53.324824+0000","last_peered":"2024-09-16T16:49:53.324824+0000","last_clean":"2024-09-16T16:49:53.324824+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:49:53.324824+0000","last_undegraded":"2024-09-16T16:49:53.324824+0000","last_fullsized":"2024-09-16T16:49:53.324824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'352","reported_seq":376,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.748297+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:49:53.748297+0000","last_peered":"2024-09-16T16:49:53.748297+0000","last_clean":"2024-09-16T16:49:53.748297+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:49:53.748297+0000","last_undegraded":"2024-09-16T16:49:53.748297+0000","last_fullsized":"2024-09-16T16:49:53.748297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'288","reported_seq":312,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.103615+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:49:53.103615+0000","last_peered":"2024-09-16T16:49:53.103615+0000","last_clean":"2024-09-16T16:49:53.103615+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:49:53.103615+0000","last_undegraded":"2024-09-16T16:49:53.103615+0000","last_fullsized":"2024-09-16T16:49:53.103615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'416","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:52.944559+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:52.944559+0000","last_peered":"2024-09-16T16:49:52.944559+0000","last_clean":"2024-09-16T16:49:52.944559+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:52.944559+0000","last_undegraded":"2024-09-16T16:49:52.944559+0000","last_fullsized":"2024-09-16T16:49:52.944559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'400","reported_seq":424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.337509+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:54.337509+0000","last_peered":"2024-09-16T16:49:54.337509+0000","last_clean":"2024-09-16T16:49:54.337509+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:54.337509+0000","last_undegraded":"2024-09-16T16:49:54.337509+0000","last_fullsized":"2024-09-16T16:49:54.337509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.814402+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:49:53.814402+0000","last_peered":"2024-09-16T16:49:53.814402+0000","last_clean":"2024-09-16T16:49:53.814402+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:49:53.814402+0000","last_undegraded":"2024-09-16T16:49:53.814402+0000","last_fullsized":"2024-09-16T16:49:53.814402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'392","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.003987+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:49:54.003987+0000","last_peered":"2024-09-16T16:49:54.003987+0000","last_clean":"2024-09-16T16:49:54.003987+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:49:54.003987+0000","last_undegraded":"2024-09-16T16:49:54.003987+0000","last_fullsized":"2024-09-16T16:49:54.003987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'384","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.157763+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:49:53.157763+0000","last_peered":"2024-09-16T16:49:53.157763+0000","last_clean":"2024-09-16T16:49:53.157763+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:49:53.157763+0000","last_undegraded":"2024-09-16T16:49:53.157763+0000","last_fullsized":"2024-09-16T16:49:53.157763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'384","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.268316+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:49:54.268316+0000","last_peered":"2024-09-16T16:49:54.268316+0000","last_clean":"2024-09-16T16:49:54.268316+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:49:54.268316+0000","last_undegraded":"2024-09-16T16:49:54.268316+0000","last_fullsized":"2024-09-16T16:49:54.268316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":50429952,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6156,"num_write_kb":49248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213891518464,"internally_reserved":0,"allocated":319975424,"data_stored":319975424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6156,"ondisk_log_size":6156,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213891526656,"internally_reserved":0,"allocated":319967232,"data_stored":319967232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":84136,"kb_used_data":84136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213592,"statfs":{"total":53552873472,"available":53466718208,"internally_reserved":0,"allocated":86155264,"data_stored":86155264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65068,"kb_used_data":65068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232660,"statfs":{"total":53552873472,"available":53486243840,"internally_reserved":0,"allocated":66629632,"data_stored":66629632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":84972,"kb_used_data":84972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52212756,"statfs":{"total":53552873472,"available":53465862144,"internally_reserved":0,"allocated":87011328,"data_stored":87011328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705845,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":78052,"kb_used_data":78052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52219676,"statfs":{"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53465772032,"internally_reserved":0,"allocated":87101440,"data_stored":87101440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53486161920,"internally_reserved":0,"allocated":66711552,"data_stored":66711552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53465772032,"internally_reserved":0,"allocated":87101440,"data_stored":87101440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53486153728,"internally_reserved":0,"allocated":66719744,"data_stored":66719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:15.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:15.061+0000 7f5e7a151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:15.070+0000 7f5e7a151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:15.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 8250 8234 0.82464 0.929688 0.20045 0.151393 2024-09-16T16:50:16.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 8341 8325 0.8232 0.710938 0.10685 0.151642 2024-09-16T16:50:17.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:50:17.197009+0000 min lat: 0.0205383 max lat: 0.728974 avg lat: 0.151831 2024-09-16T16:50:17.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:50:17.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 8434 8418 0.821992 0.726562 0.235387 0.151831 2024-09-16T16:50:17.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:17.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:17.442+0000 7f36da791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:17.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:17.449+0000 7f36da791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:18.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 8533 8517 0.821391 0.773438 0.101464 0.152043 2024-09-16T16:50:19.196 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 15 8633 8618 0.820996 0.789062 0.162803 0.152041 2024-09-16T16:50:19.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:19.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:19.912+0000 7f34ec26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:19.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:19.920+0000 7f34ec26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:19.960 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:19.961 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:19.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:20.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:20.086+0000 7fa2fe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:20.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:20.098+0000 7fa2fe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:20.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 8727 8711 0.819858 0.726562 0.178145 0.152264 2024-09-16T16:50:20.489 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:20.490 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:20.512 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-16T16:50:20.404058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":51020339,"num_objects":774,"num_object_clones":0,"num_object_copies":2322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6237,"num_write_kb":50356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6211,"ondisk_log_size":6211,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":312228,"kb_used_data":312228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208878684,"statfs":{"total":214211493888,"available":213891772416,"internally_reserved":0,"allocated":319721472,"data_stored":319721472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002544"},"pg_stats":[{"pgid":"4.f","version":"36'376","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.266353+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:49:53.266353+0000","last_peered":"2024-09-16T16:49:53.266353+0000","last_clean":"2024-09-16T16:49:53.266353+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:49:53.266353+0000","last_undegraded":"2024-09-16T16:49:53.266353+0000","last_fullsized":"2024-09-16T16:49:53.266353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.186428+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:49:54.186428+0000","last_peered":"2024-09-16T16:49:54.186428+0000","last_clean":"2024-09-16T16:49:54.186428+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:49:54.186428+0000","last_undegraded":"2024-09-16T16:49:54.186428+0000","last_fullsized":"2024-09-16T16:49:54.186428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'400","reported_seq":424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.152830+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:49:54.152830+0000","last_peered":"2024-09-16T16:49:54.152830+0000","last_clean":"2024-09-16T16:49:54.152830+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:49:54.152830+0000","last_undegraded":"2024-09-16T16:49:54.152830+0000","last_fullsized":"2024-09-16T16:49:54.152830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'432","reported_seq":456,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.929201+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:49:53.929201+0000","last_peered":"2024-09-16T16:49:53.929201+0000","last_clean":"2024-09-16T16:49:53.929201+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:49:53.929201+0000","last_undegraded":"2024-09-16T16:49:53.929201+0000","last_fullsized":"2024-09-16T16:49:53.929201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'380","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.381862+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:49:54.381862+0000","last_peered":"2024-09-16T16:49:54.381862+0000","last_clean":"2024-09-16T16:49:54.381862+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:49:54.381862+0000","last_undegraded":"2024-09-16T16:49:54.381862+0000","last_fullsized":"2024-09-16T16:49:54.381862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3112960,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":3040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'344","reported_seq":368,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.064076+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:49:54.064076+0000","last_peered":"2024-09-16T16:49:54.064076+0000","last_clean":"2024-09-16T16:49:54.064076+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:49:54.064076+0000","last_undegraded":"2024-09-16T16:49:54.064076+0000","last_fullsized":"2024-09-16T16:49:54.064076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'368","reported_seq":392,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:50.554359+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:49:50.554359+0000","last_peered":"2024-09-16T16:49:50.554359+0000","last_clean":"2024-09-16T16:49:50.554359+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:49:50.554359+0000","last_undegraded":"2024-09-16T16:49:50.554359+0000","last_fullsized":"2024-09-16T16:49:50.554359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'424","reported_seq":448,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.324824+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:49:53.324824+0000","last_peered":"2024-09-16T16:49:53.324824+0000","last_clean":"2024-09-16T16:49:53.324824+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:49:53.324824+0000","last_undegraded":"2024-09-16T16:49:53.324824+0000","last_fullsized":"2024-09-16T16:49:53.324824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'352","reported_seq":376,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.748297+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:49:53.748297+0000","last_peered":"2024-09-16T16:49:53.748297+0000","last_clean":"2024-09-16T16:49:53.748297+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:49:53.748297+0000","last_undegraded":"2024-09-16T16:49:53.748297+0000","last_fullsized":"2024-09-16T16:49:53.748297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'288","reported_seq":312,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.103615+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:49:53.103615+0000","last_peered":"2024-09-16T16:49:53.103615+0000","last_clean":"2024-09-16T16:49:53.103615+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:49:53.103615+0000","last_undegraded":"2024-09-16T16:49:53.103615+0000","last_fullsized":"2024-09-16T16:49:53.103615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'416","reported_seq":440,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:52.944559+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:49:52.944559+0000","last_peered":"2024-09-16T16:49:52.944559+0000","last_clean":"2024-09-16T16:49:52.944559+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:49:52.944559+0000","last_undegraded":"2024-09-16T16:49:52.944559+0000","last_fullsized":"2024-09-16T16:49:52.944559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'400","reported_seq":424,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.337509+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:49:54.337509+0000","last_peered":"2024-09-16T16:49:54.337509+0000","last_clean":"2024-09-16T16:49:54.337509+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:49:54.337509+0000","last_undegraded":"2024-09-16T16:49:54.337509+0000","last_fullsized":"2024-09-16T16:49:54.337509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.814402+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:49:53.814402+0000","last_peered":"2024-09-16T16:49:53.814402+0000","last_clean":"2024-09-16T16:49:53.814402+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:49:53.814402+0000","last_undegraded":"2024-09-16T16:49:53.814402+0000","last_fullsized":"2024-09-16T16:49:53.814402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'392","reported_seq":416,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.003987+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:49:54.003987+0000","last_peered":"2024-09-16T16:49:54.003987+0000","last_clean":"2024-09-16T16:49:54.003987+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:49:54.003987+0000","last_undegraded":"2024-09-16T16:49:54.003987+0000","last_fullsized":"2024-09-16T16:49:54.003987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'384","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:53.157763+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:49:53.157763+0000","last_peered":"2024-09-16T16:49:53.157763+0000","last_clean":"2024-09-16T16:49:53.157763+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:49:53.157763+0000","last_undegraded":"2024-09-16T16:49:53.157763+0000","last_fullsized":"2024-09-16T16:49:53.157763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'384","reported_seq":408,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:54.268316+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:49:54.268316+0000","last_peered":"2024-09-16T16:49:54.268316+0000","last_clean":"2024-09-16T16:49:54.268316+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:49:54.268316+0000","last_undegraded":"2024-09-16T16:49:54.268316+0000","last_fullsized":"2024-09-16T16:49:54.268316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":50429952,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6156,"num_write_kb":49248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213891518464,"internally_reserved":0,"allocated":319975424,"data_stored":319975424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6156,"ondisk_log_size":6156,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213891526656,"internally_reserved":0,"allocated":319967232,"data_stored":319967232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":84136,"kb_used_data":84136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213592,"statfs":{"total":53552873472,"available":53466718208,"internally_reserved":0,"allocated":86155264,"data_stored":86155264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65068,"kb_used_data":65068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232660,"statfs":{"total":53552873472,"available":53486243840,"internally_reserved":0,"allocated":66629632,"data_stored":66629632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":84972,"kb_used_data":84972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52212756,"statfs":{"total":53552873472,"available":53465862144,"internally_reserved":0,"allocated":87011328,"data_stored":87011328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705845,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":78052,"kb_used_data":78052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52219676,"statfs":{"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53465772032,"internally_reserved":0,"allocated":87101440,"data_stored":87101440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53486161920,"internally_reserved":0,"allocated":66711552,"data_stored":66711552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53472948224,"internally_reserved":0,"allocated":79925248,"data_stored":79925248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53465772032,"internally_reserved":0,"allocated":87101440,"data_stored":87101440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53486153728,"internally_reserved":0,"allocated":66719744,"data_stored":66719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53466644480,"internally_reserved":0,"allocated":86228992,"data_stored":86228992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:21.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 8831 8815 0.819769 0.8125 0.16254 0.15232 2024-09-16T16:50:22.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 8919 8903 0.818212 0.6875 0.261916 0.152516 2024-09-16T16:50:22.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:22.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:22.413+0000 7fed4a888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:22.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:22.424+0000 7fed4a888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:23.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 9011 8995 0.817055 0.71875 0.232705 0.152725 2024-09-16T16:50:24.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 9107 9091 0.816283 0.75 0.193942 0.152905 2024-09-16T16:50:24.797 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:24.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:24.935+0000 7fa1fd6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:24.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:24.944+0000 7fa1fd6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:25.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 15 9203 9188 0.815618 0.757812 0.143861 0.153092 2024-09-16T16:50:25.515 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:25.515 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:25.515 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:50:25.515 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:50:25.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:25.672+0000 7f4c3c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:25.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:25.685+0000 7f4c3c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:25.797 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:25.797 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:25.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:50:25.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:25.917+0000 7efe69951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:25.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:25.929+0000 7efe69951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:25.954 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:25.954 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:25.954 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:25.954 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:25.957 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:25.957 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:25.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:50:26.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:26.084+0000 7f40a1c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:26.095+0000 7f40a1c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:26.134 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:26.134 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:26.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:50:26.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 9293 9277 0.814265 0.695312 0.181623 0.153198 2024-09-16T16:50:26.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:26.254+0000 7fb7346fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:26.266+0000 7fb7346fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:26.289 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:26.289 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:27.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 15 9389 9374 0.813637 0.757812 0.22096 0.153509 2024-09-16T16:50:27.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:27.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:27.437+0000 7fa863711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:27.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:27.443+0000 7fa863711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:28.197 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.1789 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 9389 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.8134 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.110597 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 1.11719 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.53125 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 104 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 14.1564 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 143 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 68 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.153516 2024-09-16T16:50:28.198 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.0827464 2024-09-16T16:50:28.199 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 0.728974 2024-09-16T16:50:28.199 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0205383 2024-09-16T16:50:28.235 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:50:29.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:29.692+0000 7f5128191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:29.700+0000 7f5128191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:31.290 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:31.290 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:31.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:31.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:31.459+0000 7fa229c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:31.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:31.470+0000 7fa229c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:31.753 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:31.754 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:31.769 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-16T16:50:30.406096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75309619,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9202,"num_write_kb":74076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9176,"ondisk_log_size":9176,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":458028,"kb_used_data":458028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208732884,"statfs":{"total":214211493888,"available":213742473216,"internally_reserved":0,"allocated":469020672,"data_stored":469020672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24289280,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2965,"num_write_kb":23720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002483"},"pg_stats":[{"pgid":"4.f","version":"36'544","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.973681+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:50:23.973681+0000","last_peered":"2024-09-16T16:50:23.973681+0000","last_clean":"2024-09-16T16:50:23.973681+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:50:23.973681+0000","last_undegraded":"2024-09-16T16:50:23.973681+0000","last_fullsized":"2024-09-16T16:50:23.973681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'552","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:22.347223+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:50:22.347223+0000","last_peered":"2024-09-16T16:50:22.347223+0000","last_clean":"2024-09-16T16:50:22.347223+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:50:22.347223+0000","last_undegraded":"2024-09-16T16:50:22.347223+0000","last_fullsized":"2024-09-16T16:50:22.347223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'608","reported_seq":632,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.871415+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:50:23.871415+0000","last_peered":"2024-09-16T16:50:23.871415+0000","last_clean":"2024-09-16T16:50:23.871415+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:50:23.871415+0000","last_undegraded":"2024-09-16T16:50:23.871415+0000","last_fullsized":"2024-09-16T16:50:23.871415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'600","reported_seq":624,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:20.876153+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:50:20.876153+0000","last_peered":"2024-09-16T16:50:20.876153+0000","last_clean":"2024-09-16T16:50:20.876153+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:50:20.876153+0000","last_undegraded":"2024-09-16T16:50:20.876153+0000","last_fullsized":"2024-09-16T16:50:20.876153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'584","reported_seq":608,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.633882+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:50:23.633882+0000","last_peered":"2024-09-16T16:50:23.633882+0000","last_clean":"2024-09-16T16:50:23.633882+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:50:23.633882+0000","last_undegraded":"2024-09-16T16:50:23.633882+0000","last_fullsized":"2024-09-16T16:50:23.633882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'553","reported_seq":577,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:22.678282+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:50:22.678282+0000","last_peered":"2024-09-16T16:50:22.678282+0000","last_clean":"2024-09-16T16:50:22.678282+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:50:22.678282+0000","last_undegraded":"2024-09-16T16:50:22.678282+0000","last_fullsized":"2024-09-16T16:50:22.678282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4530176,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'536","reported_seq":560,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.461834+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:50:23.461834+0000","last_peered":"2024-09-16T16:50:23.461834+0000","last_clean":"2024-09-16T16:50:23.461834+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:50:23.461834+0000","last_undegraded":"2024-09-16T16:50:23.461834+0000","last_fullsized":"2024-09-16T16:50:23.461834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'656","reported_seq":680,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:21.285131+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:50:21.285131+0000","last_peered":"2024-09-16T16:50:21.285131+0000","last_clean":"2024-09-16T16:50:21.285131+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:50:21.285131+0000","last_undegraded":"2024-09-16T16:50:21.285131+0000","last_fullsized":"2024-09-16T16:50:21.285131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'520","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.537828+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:50:23.537828+0000","last_peered":"2024-09-16T16:50:23.537828+0000","last_clean":"2024-09-16T16:50:23.537828+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:50:23.537828+0000","last_undegraded":"2024-09-16T16:50:23.537828+0000","last_fullsized":"2024-09-16T16:50:23.537828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:24.377742+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:50:24.377742+0000","last_peered":"2024-09-16T16:50:24.377742+0000","last_clean":"2024-09-16T16:50:24.377742+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:50:24.377742+0000","last_undegraded":"2024-09-16T16:50:24.377742+0000","last_fullsized":"2024-09-16T16:50:24.377742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'632","reported_seq":656,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.715226+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:50:23.715226+0000","last_peered":"2024-09-16T16:50:23.715226+0000","last_clean":"2024-09-16T16:50:23.715226+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:50:23.715226+0000","last_undegraded":"2024-09-16T16:50:23.715226+0000","last_fullsized":"2024-09-16T16:50:23.715226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'616","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:19.403773+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:50:19.403773+0000","last_peered":"2024-09-16T16:50:19.403773+0000","last_clean":"2024-09-16T16:50:19.403773+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:50:19.403773+0000","last_undegraded":"2024-09-16T16:50:19.403773+0000","last_fullsized":"2024-09-16T16:50:19.403773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'568","reported_seq":592,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:20.500995+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:50:20.500995+0000","last_peered":"2024-09-16T16:50:20.500995+0000","last_clean":"2024-09-16T16:50:20.500995+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:50:20.500995+0000","last_undegraded":"2024-09-16T16:50:20.500995+0000","last_fullsized":"2024-09-16T16:50:20.500995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'544","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:24.285068+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:50:24.285068+0000","last_peered":"2024-09-16T16:50:24.285068+0000","last_clean":"2024-09-16T16:50:24.285068+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:50:24.285068+0000","last_undegraded":"2024-09-16T16:50:24.285068+0000","last_fullsized":"2024-09-16T16:50:24.285068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'584","reported_seq":608,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:21.370670+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:50:21.370670+0000","last_peered":"2024-09-16T16:50:21.370670+0000","last_clean":"2024-09-16T16:50:21.370670+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:50:21.370670+0000","last_undegraded":"2024-09-16T16:50:21.370670+0000","last_fullsized":"2024-09-16T16:50:21.370670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'616","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:24.164929+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:50:24.164929+0000","last_peered":"2024-09-16T16:50:24.164929+0000","last_clean":"2024-09-16T16:50:24.164929+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:50:24.164929+0000","last_undegraded":"2024-09-16T16:50:24.164929+0000","last_fullsized":"2024-09-16T16:50:24.164929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":74719232,"num_objects":1141,"num_object_clones":0,"num_object_copies":3423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9121,"num_write_kb":72968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740040192,"internally_reserved":0,"allocated":471453696,"data_stored":471453696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9121,"ondisk_log_size":9121,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740048384,"internally_reserved":0,"allocated":471445504,"data_stored":471445504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124040,"kb_used_data":124040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173688,"statfs":{"total":53552873472,"available":53425856512,"internally_reserved":0,"allocated":127016960,"data_stored":127016960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":94060,"kb_used_data":94060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52203668,"statfs":{"total":53552873472,"available":53456556032,"internally_reserved":0,"allocated":96317440,"data_stored":96317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":126084,"kb_used_data":126084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52171644,"statfs":{"total":53552873472,"available":53423763456,"internally_reserved":0,"allocated":129110016,"data_stored":129110016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":113844,"kb_used_data":113844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52183884,"statfs":{"total":53552873472,"available":53436297216,"internally_reserved":0,"allocated":116576256,"data_stored":116576256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434888192,"internally_reserved":0,"allocated":117985280,"data_stored":117985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53423747072,"internally_reserved":0,"allocated":129126400,"data_stored":129126400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53455581184,"internally_reserved":0,"allocated":97292288,"data_stored":97292288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53434888192,"internally_reserved":0,"allocated":117985280,"data_stored":117985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53423747072,"internally_reserved":0,"allocated":129126400,"data_stored":129126400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53455581184,"internally_reserved":0,"allocated":97292288,"data_stored":97292288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53425823744,"internally_reserved":0,"allocated":127049728,"data_stored":127049728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:32.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:32.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:32.345+0000 7f524e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:32.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:32.354+0000 7f524e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:34.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:34.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:34.883+0000 7f1dfe911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:34.890+0000 7f1dfe911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:36.771 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:36.771 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:36.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:36.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:36.911+0000 7fc566991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:36.922+0000 7fc566991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:37.283 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:37.301 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-16T16:50:36.407118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75309619,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9202,"num_write_kb":74076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9176,"ondisk_log_size":9176,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":458028,"kb_used_data":458028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208732884,"statfs":{"total":214211493888,"available":213742473216,"internally_reserved":0,"allocated":469020672,"data_stored":469020672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002319"},"pg_stats":[{"pgid":"4.f","version":"36'544","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.973681+0000","last_change":"2024-09-16T16:48:56.235381+0000","last_active":"2024-09-16T16:50:23.973681+0000","last_peered":"2024-09-16T16:50:23.973681+0000","last_clean":"2024-09-16T16:50:23.973681+0000","last_became_active":"2024-09-16T16:48:56.211286+0000","last_became_peered":"2024-09-16T16:48:56.211286+0000","last_unstale":"2024-09-16T16:50:23.973681+0000","last_undegraded":"2024-09-16T16:50:23.973681+0000","last_fullsized":"2024-09-16T16:50:23.973681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"36'552","reported_seq":576,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:22.347223+0000","last_change":"2024-09-16T16:48:56.267955+0000","last_active":"2024-09-16T16:50:22.347223+0000","last_peered":"2024-09-16T16:50:22.347223+0000","last_clean":"2024-09-16T16:50:22.347223+0000","last_became_active":"2024-09-16T16:48:56.261031+0000","last_became_peered":"2024-09-16T16:48:56.261031+0000","last_unstale":"2024-09-16T16:50:22.347223+0000","last_undegraded":"2024-09-16T16:50:22.347223+0000","last_fullsized":"2024-09-16T16:50:22.347223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"36'608","reported_seq":632,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.871415+0000","last_change":"2024-09-16T16:48:56.318576+0000","last_active":"2024-09-16T16:50:23.871415+0000","last_peered":"2024-09-16T16:50:23.871415+0000","last_clean":"2024-09-16T16:50:23.871415+0000","last_became_active":"2024-09-16T16:48:56.299024+0000","last_became_peered":"2024-09-16T16:48:56.299024+0000","last_unstale":"2024-09-16T16:50:23.871415+0000","last_undegraded":"2024-09-16T16:50:23.871415+0000","last_fullsized":"2024-09-16T16:50:23.871415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'600","reported_seq":624,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:20.876153+0000","last_change":"2024-09-16T16:48:56.289535+0000","last_active":"2024-09-16T16:50:20.876153+0000","last_peered":"2024-09-16T16:50:20.876153+0000","last_clean":"2024-09-16T16:50:20.876153+0000","last_became_active":"2024-09-16T16:48:56.278677+0000","last_became_peered":"2024-09-16T16:48:56.278677+0000","last_unstale":"2024-09-16T16:50:20.876153+0000","last_undegraded":"2024-09-16T16:50:20.876153+0000","last_fullsized":"2024-09-16T16:50:20.876153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"36'584","reported_seq":608,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.633882+0000","last_change":"2024-09-16T16:48:56.232927+0000","last_active":"2024-09-16T16:50:23.633882+0000","last_peered":"2024-09-16T16:50:23.633882+0000","last_clean":"2024-09-16T16:50:23.633882+0000","last_became_active":"2024-09-16T16:48:56.213683+0000","last_became_peered":"2024-09-16T16:48:56.213683+0000","last_unstale":"2024-09-16T16:50:23.633882+0000","last_undegraded":"2024-09-16T16:50:23.633882+0000","last_fullsized":"2024-09-16T16:50:23.633882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"36'553","reported_seq":577,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:22.678282+0000","last_change":"2024-09-16T16:48:56.241181+0000","last_active":"2024-09-16T16:50:22.678282+0000","last_peered":"2024-09-16T16:50:22.678282+0000","last_clean":"2024-09-16T16:50:22.678282+0000","last_became_active":"2024-09-16T16:48:56.203395+0000","last_became_peered":"2024-09-16T16:48:56.203395+0000","last_unstale":"2024-09-16T16:50:22.678282+0000","last_undegraded":"2024-09-16T16:50:22.678282+0000","last_fullsized":"2024-09-16T16:50:22.678282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4530176,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":4424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"36'536","reported_seq":560,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.461834+0000","last_change":"2024-09-16T16:48:56.284039+0000","last_active":"2024-09-16T16:50:23.461834+0000","last_peered":"2024-09-16T16:50:23.461834+0000","last_clean":"2024-09-16T16:50:23.461834+0000","last_became_active":"2024-09-16T16:48:56.255373+0000","last_became_peered":"2024-09-16T16:48:56.255373+0000","last_unstale":"2024-09-16T16:50:23.461834+0000","last_undegraded":"2024-09-16T16:50:23.461834+0000","last_fullsized":"2024-09-16T16:50:23.461834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'656","reported_seq":680,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:21.285131+0000","last_change":"2024-09-16T16:48:56.247309+0000","last_active":"2024-09-16T16:50:21.285131+0000","last_peered":"2024-09-16T16:50:21.285131+0000","last_clean":"2024-09-16T16:50:21.285131+0000","last_became_active":"2024-09-16T16:48:56.194169+0000","last_became_peered":"2024-09-16T16:48:56.194169+0000","last_unstale":"2024-09-16T16:50:21.285131+0000","last_undegraded":"2024-09-16T16:50:21.285131+0000","last_fullsized":"2024-09-16T16:50:21.285131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'520","reported_seq":544,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.537828+0000","last_change":"2024-09-16T16:48:56.292659+0000","last_active":"2024-09-16T16:50:23.537828+0000","last_peered":"2024-09-16T16:50:23.537828+0000","last_clean":"2024-09-16T16:50:23.537828+0000","last_became_active":"2024-09-16T16:48:56.280333+0000","last_became_peered":"2024-09-16T16:48:56.280333+0000","last_unstale":"2024-09-16T16:50:23.537828+0000","last_undegraded":"2024-09-16T16:50:23.537828+0000","last_fullsized":"2024-09-16T16:50:23.537828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"36'408","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:24.377742+0000","last_change":"2024-09-16T16:48:56.303443+0000","last_active":"2024-09-16T16:50:24.377742+0000","last_peered":"2024-09-16T16:50:24.377742+0000","last_clean":"2024-09-16T16:50:24.377742+0000","last_became_active":"2024-09-16T16:48:56.295080+0000","last_became_peered":"2024-09-16T16:48:56.295080+0000","last_unstale":"2024-09-16T16:50:24.377742+0000","last_undegraded":"2024-09-16T16:50:24.377742+0000","last_fullsized":"2024-09-16T16:50:24.377742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"36'632","reported_seq":656,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:23.715226+0000","last_change":"2024-09-16T16:48:56.228628+0000","last_active":"2024-09-16T16:50:23.715226+0000","last_peered":"2024-09-16T16:50:23.715226+0000","last_clean":"2024-09-16T16:50:23.715226+0000","last_became_active":"2024-09-16T16:48:56.210426+0000","last_became_peered":"2024-09-16T16:48:56.210426+0000","last_unstale":"2024-09-16T16:50:23.715226+0000","last_undegraded":"2024-09-16T16:50:23.715226+0000","last_fullsized":"2024-09-16T16:50:23.715226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"36'616","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:19.403773+0000","last_change":"2024-09-16T16:48:56.224004+0000","last_active":"2024-09-16T16:50:19.403773+0000","last_peered":"2024-09-16T16:50:19.403773+0000","last_clean":"2024-09-16T16:50:19.403773+0000","last_became_active":"2024-09-16T16:48:56.193888+0000","last_became_peered":"2024-09-16T16:48:56.193888+0000","last_unstale":"2024-09-16T16:50:19.403773+0000","last_undegraded":"2024-09-16T16:50:19.403773+0000","last_fullsized":"2024-09-16T16:50:19.403773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"36'568","reported_seq":592,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:20.500995+0000","last_change":"2024-09-16T16:48:56.232285+0000","last_active":"2024-09-16T16:50:20.500995+0000","last_peered":"2024-09-16T16:50:20.500995+0000","last_clean":"2024-09-16T16:50:20.500995+0000","last_became_active":"2024-09-16T16:48:56.223337+0000","last_became_peered":"2024-09-16T16:48:56.223337+0000","last_unstale":"2024-09-16T16:50:20.500995+0000","last_undegraded":"2024-09-16T16:50:20.500995+0000","last_fullsized":"2024-09-16T16:50:20.500995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'544","reported_seq":568,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:24.285068+0000","last_change":"2024-09-16T16:48:56.283493+0000","last_active":"2024-09-16T16:50:24.285068+0000","last_peered":"2024-09-16T16:50:24.285068+0000","last_clean":"2024-09-16T16:50:24.285068+0000","last_became_active":"2024-09-16T16:48:56.239376+0000","last_became_peered":"2024-09-16T16:48:56.239376+0000","last_unstale":"2024-09-16T16:50:24.285068+0000","last_undegraded":"2024-09-16T16:50:24.285068+0000","last_fullsized":"2024-09-16T16:50:24.285068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'584","reported_seq":608,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:21.370670+0000","last_change":"2024-09-16T16:48:56.270224+0000","last_active":"2024-09-16T16:50:21.370670+0000","last_peered":"2024-09-16T16:50:21.370670+0000","last_clean":"2024-09-16T16:50:21.370670+0000","last_became_active":"2024-09-16T16:48:56.244659+0000","last_became_peered":"2024-09-16T16:48:56.244659+0000","last_unstale":"2024-09-16T16:50:21.370670+0000","last_undegraded":"2024-09-16T16:50:21.370670+0000","last_fullsized":"2024-09-16T16:50:21.370670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"36'616","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:50:24.164929+0000","last_change":"2024-09-16T16:48:56.292252+0000","last_active":"2024-09-16T16:50:24.164929+0000","last_peered":"2024-09-16T16:50:24.164929+0000","last_clean":"2024-09-16T16:50:24.164929+0000","last_became_active":"2024-09-16T16:48:56.267289+0000","last_became_peered":"2024-09-16T16:48:56.267289+0000","last_unstale":"2024-09-16T16:50:24.164929+0000","last_undegraded":"2024-09-16T16:50:24.164929+0000","last_fullsized":"2024-09-16T16:50:24.164929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:48:55.066684+0000","last_clean_scrub_stamp":"2024-09-16T16:48:55.066684+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":74719232,"num_objects":1141,"num_object_clones":0,"num_object_copies":3423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9121,"num_write_kb":72968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740040192,"internally_reserved":0,"allocated":471453696,"data_stored":471453696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9121,"ondisk_log_size":9121,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740048384,"internally_reserved":0,"allocated":471445504,"data_stored":471445504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124040,"kb_used_data":124040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173688,"statfs":{"total":53552873472,"available":53425856512,"internally_reserved":0,"allocated":127016960,"data_stored":127016960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":94060,"kb_used_data":94060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52203668,"statfs":{"total":53552873472,"available":53456556032,"internally_reserved":0,"allocated":96317440,"data_stored":96317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":126084,"kb_used_data":126084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52171644,"statfs":{"total":53552873472,"available":53423763456,"internally_reserved":0,"allocated":129110016,"data_stored":129110016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":113844,"kb_used_data":113844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52183884,"statfs":{"total":53552873472,"available":53436297216,"internally_reserved":0,"allocated":116576256,"data_stored":116576256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434888192,"internally_reserved":0,"allocated":117985280,"data_stored":117985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53423747072,"internally_reserved":0,"allocated":129126400,"data_stored":129126400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53455581184,"internally_reserved":0,"allocated":97292288,"data_stored":97292288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":53552873472,"available":53434888192,"internally_reserved":0,"allocated":117985280,"data_stored":117985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":53552873472,"available":53423747072,"internally_reserved":0,"allocated":129126400,"data_stored":129126400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":53552873472,"available":53455581184,"internally_reserved":0,"allocated":97292288,"data_stored":97292288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":53552873472,"available":53425823744,"internally_reserved":0,"allocated":127049728,"data_stored":127049728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:37.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:37.535+0000 7f8ccc911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:37.546+0000 7f8ccc911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:39.634 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1174 objects 2024-09-16T16:50:39.634 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :11.3985 2024-09-16T16:50:40.116 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:40.247+0000 7f008ec93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:40.254+0000 7f008ec93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:40.840 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-16T16:50:40.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-16T16:50:40.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:40.955+0000 7f5f22591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:40.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:40.969+0000 7f5f22591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:41.224 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_1' removed 2024-09-16T16:50:41.243 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:50:41.243 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:50:41.244 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-16T16:50:41.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-16T16:50:41.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:41.399+0000 7fa7ccd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:41.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:41.416+0000 7fa7ccd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.229 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_2' created 2024-09-16T16:50:42.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-16T16:50:42.303 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:42.304 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:42.304 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:50:42.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:50:42.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:42.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.388+0000 7ff20acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.406+0000 7ff20acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.447+0000 7f9e59591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.457+0000 7f9e59591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:42.478 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:42.479 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:42.482 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:42.483 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:42.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:50:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.503+0000 7fafaf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.509+0000 7fafaf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.629+0000 7ff8b1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.639+0000 7ff8b1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:42.661 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:42.661 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:42.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:50:42.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.809+0000 7ff8586bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.818+0000 7ff8586bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:42.839 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:42.840 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:42.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:50:42.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.948+0000 7f46d9951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:42.957+0000 7f46d9951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:50:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:50:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:50:42.978 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:50:42.979 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:50:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-16T16:50:44.257 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-16T16:50:44.260 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:50:44.260 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:50:44.329 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:50:44.329 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:50:44.329 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_38673 2024-09-16T16:50:44.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:50:44.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:50:44.635 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:44.797+0000 7f49506bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:44.806+0000 7f49506bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:45.329 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 137 121 0.945249 0.945312 0.120064 0.111356 2024-09-16T16:50:46.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 284 268 1.04679 1.14844 0.108955 0.116021 2024-09-16T16:50:47.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:47.256+0000 7f1ce1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:47.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:47.264+0000 7f1ce1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:47.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 399 383 0.997307 0.898438 0.0402691 0.120484 2024-09-16T16:50:47.980 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:47.980 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:47.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:48.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:48.124+0000 7f3ac5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:48.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:48.137+0000 7f3ac5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:48.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 16 518 502 0.980382 0.929688 0.0629441 0.124205 2024-09-16T16:50:48.528 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:48.529 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:48.548 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-16T16:50:48.409358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":458028,"kb_used_data":458028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208732884,"statfs":{"total":214211493888,"available":213742473216,"internally_reserved":0,"allocated":469020672,"data_stored":469020672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.179189"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740048384,"internally_reserved":0,"allocated":471445504,"data_stored":471445504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124040,"kb_used_data":124040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173688,"statfs":{"total":53552873472,"available":53425856512,"internally_reserved":0,"allocated":127016960,"data_stored":127016960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":94060,"kb_used_data":94060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52203668,"statfs":{"total":53552873472,"available":53456556032,"internally_reserved":0,"allocated":96317440,"data_stored":96317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":126084,"kb_used_data":126084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52171644,"statfs":{"total":53552873472,"available":53423763456,"internally_reserved":0,"allocated":129110016,"data_stored":129110016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":113844,"kb_used_data":113844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52183884,"statfs":{"total":53552873472,"available":53436297216,"internally_reserved":0,"allocated":116576256,"data_stored":116576256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434888192,"internally_reserved":0,"allocated":117985280,"data_stored":117985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53423747072,"internally_reserved":0,"allocated":129126400,"data_stored":129126400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53455581184,"internally_reserved":0,"allocated":97292288,"data_stored":97292288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:49.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 598 582 0.909291 0.625 0.13279 0.135337 2024-09-16T16:50:49.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:49.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:49.547+0000 7f6c9a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:49.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:49.554+0000 7f6c9a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:50.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 721 705 0.917882 0.960938 0.092516 0.13431 2024-09-16T16:50:51.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 831 815 0.909511 0.859375 0.190173 0.13502 2024-09-16T16:50:51.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:51.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:51.891+0000 7f2db36d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:51.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:51.899+0000 7f2db36d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:52.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 943 927 0.905188 0.875 0.17207 0.136258 2024-09-16T16:50:53.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 1049 1033 0.896618 0.828125 0.151563 0.138107 2024-09-16T16:50:53.550 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:53.551 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:53.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:53.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:53.717+0000 7fd694d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:53.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:53.729+0000 7fd694d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:54.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:54.076 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:54.101 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-16T16:50:52.410120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":458028,"kb_used_data":458028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208732884,"statfs":{"total":214211493888,"available":213742473216,"internally_reserved":0,"allocated":469020672,"data_stored":469020672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.176285"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.122274+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:49:01.122274+0000","last_peered":"2024-09-16T16:49:01.122274+0000","last_clean":"2024-09-16T16:49:01.122274+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:49:01.122274+0000","last_undegraded":"2024-09-16T16:49:01.122274+0000","last_fullsized":"2024-09-16T16:49:01.122274+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.169431+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:49:01.169431+0000","last_peered":"2024-09-16T16:49:01.169431+0000","last_clean":"2024-09-16T16:49:01.169431+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:49:01.169431+0000","last_undegraded":"2024-09-16T16:49:01.169431+0000","last_fullsized":"2024-09-16T16:49:01.169431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.079157+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:49:03.079157+0000","last_peered":"2024-09-16T16:49:03.079157+0000","last_clean":"2024-09-16T16:49:03.079157+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:49:03.079157+0000","last_undegraded":"2024-09-16T16:49:03.079157+0000","last_fullsized":"2024-09-16T16:49:03.079157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.161372+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:49:01.161372+0000","last_peered":"2024-09-16T16:49:01.161372+0000","last_clean":"2024-09-16T16:49:01.161372+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:49:01.161372+0000","last_undegraded":"2024-09-16T16:49:01.161372+0000","last_fullsized":"2024-09-16T16:49:01.161372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:03.073091+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:49:03.073091+0000","last_peered":"2024-09-16T16:49:03.073091+0000","last_clean":"2024-09-16T16:49:03.073091+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:49:03.073091+0000","last_undegraded":"2024-09-16T16:49:03.073091+0000","last_fullsized":"2024-09-16T16:49:03.073091+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.143778+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:49:01.143778+0000","last_peered":"2024-09-16T16:49:01.143778+0000","last_clean":"2024-09-16T16:49:01.143778+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:49:01.143778+0000","last_undegraded":"2024-09-16T16:49:01.143778+0000","last_fullsized":"2024-09-16T16:49:01.143778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.128816+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:49:01.128816+0000","last_peered":"2024-09-16T16:49:01.128816+0000","last_clean":"2024-09-16T16:49:01.128816+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:49:01.128816+0000","last_undegraded":"2024-09-16T16:49:01.128816+0000","last_fullsized":"2024-09-16T16:49:01.128816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.137606+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:49:01.137606+0000","last_peered":"2024-09-16T16:49:01.137606+0000","last_clean":"2024-09-16T16:49:01.137606+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:49:01.137606+0000","last_undegraded":"2024-09-16T16:49:01.137606+0000","last_fullsized":"2024-09-16T16:49:01.137606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:50:42.225444+0000","last_change":"2024-09-16T16:50:42.225444+0000","last_active":"2024-09-16T16:50:42.225444+0000","last_peered":"2024-09-16T16:50:42.225444+0000","last_clean":"2024-09-16T16:50:42.225444+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:50:42.225444+0000","last_undegraded":"2024-09-16T16:50:42.225444+0000","last_fullsized":"2024-09-16T16:50:42.225444+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T16:49:01.168408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:49:01.168408+0000","last_peered":"2024-09-16T16:49:01.168408+0000","last_clean":"2024-09-16T16:49:01.168408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:49:01.168408+0000","last_undegraded":"2024-09-16T16:49:01.168408+0000","last_fullsized":"2024-09-16T16:49:01.168408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740048384,"internally_reserved":0,"allocated":471445504,"data_stored":471445504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124040,"kb_used_data":124040,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173688,"statfs":{"total":53552873472,"available":53425856512,"internally_reserved":0,"allocated":127016960,"data_stored":127016960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":94060,"kb_used_data":94060,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52203668,"statfs":{"total":53552873472,"available":53456556032,"internally_reserved":0,"allocated":96317440,"data_stored":96317440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":126084,"kb_used_data":126084,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52171644,"statfs":{"total":53552873472,"available":53423763456,"internally_reserved":0,"allocated":129110016,"data_stored":129110016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":113844,"kb_used_data":113844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52183884,"statfs":{"total":53552873472,"available":53436297216,"internally_reserved":0,"allocated":116576256,"data_stored":116576256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53434888192,"internally_reserved":0,"allocated":117985280,"data_stored":117985280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53423747072,"internally_reserved":0,"allocated":129126400,"data_stored":129126400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53455581184,"internally_reserved":0,"allocated":97292288,"data_stored":97292288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53425831936,"internally_reserved":0,"allocated":127041536,"data_stored":127041536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:50:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:54.203+0000 7fb8c9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:54.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:54.212+0000 7fb8c9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:54.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 1172 1156 0.90304 0.960938 0.115112 0.137601 2024-09-16T16:50:55.330 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1280 1264 0.897643 0.84375 0.190884 0.137682 2024-09-16T16:50:56.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1393 1377 0.896402 0.882812 0.19279 0.138615 2024-09-16T16:50:56.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:50:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:56.652+0000 7f1bf9ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:56.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:56.660+0000 7f1bf9ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:57.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1496 1480 0.889342 0.804688 0.0824551 0.139466 2024-09-16T16:50:58.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1626 1610 0.898355 1.01562 0.25269 0.138205 2024-09-16T16:50:58.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:50:59.103 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:50:59.103 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:50:59.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:50:59.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:59.107+0000 7fbc44751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:59.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:59.117+0000 7fbc44751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:59.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:59.271+0000 7f979e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:59.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:50:59.287+0000 7f979e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:50:59.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1730 1714 0.892628 0.8125 0.162228 0.139143 2024-09-16T16:50:59.587 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:50:59.588 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:50:59.601 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-16T16:50:58.411311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10240563,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1259,"num_write_kb":10532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1233,"ondisk_log_size":1233,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":63068,"kb_used_data":63068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209127844,"statfs":{"total":214211493888,"available":214146912256,"internally_reserved":0,"allocated":64581632,"data_stored":64581632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9650176,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002283"},"pg_stats":[{"pgid":"5.f","version":"40'48","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.005800+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:50:52.005800+0000","last_peered":"2024-09-16T16:50:52.005800+0000","last_clean":"2024-09-16T16:50:52.005800+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:50:52.005800+0000","last_undegraded":"2024-09-16T16:50:52.005800+0000","last_fullsized":"2024-09-16T16:50:52.005800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:50.800861+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:50:50.800861+0000","last_peered":"2024-09-16T16:50:50.800861+0000","last_clean":"2024-09-16T16:50:50.800861+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:50:50.800861+0000","last_undegraded":"2024-09-16T16:50:50.800861+0000","last_fullsized":"2024-09-16T16:50:50.800861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.197998+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:50:54.197998+0000","last_peered":"2024-09-16T16:50:54.197998+0000","last_clean":"2024-09-16T16:50:54.197998+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:50:54.197998+0000","last_undegraded":"2024-09-16T16:50:54.197998+0000","last_fullsized":"2024-09-16T16:50:54.197998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'136","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.561233+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:50:53.561233+0000","last_peered":"2024-09-16T16:50:53.561233+0000","last_clean":"2024-09-16T16:50:53.561233+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:50:53.561233+0000","last_undegraded":"2024-09-16T16:50:53.561233+0000","last_fullsized":"2024-09-16T16:50:53.561233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.716532+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:50:53.716532+0000","last_peered":"2024-09-16T16:50:53.716532+0000","last_clean":"2024-09-16T16:50:53.716532+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:50:53.716532+0000","last_undegraded":"2024-09-16T16:50:53.716532+0000","last_fullsized":"2024-09-16T16:50:53.716532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.097913+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:50:52.097913+0000","last_peered":"2024-09-16T16:50:52.097913+0000","last_clean":"2024-09-16T16:50:52.097913+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:50:52.097913+0000","last_undegraded":"2024-09-16T16:50:52.097913+0000","last_fullsized":"2024-09-16T16:50:52.097913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.797756+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:50:52.797756+0000","last_peered":"2024-09-16T16:50:52.797756+0000","last_clean":"2024-09-16T16:50:52.797756+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:50:52.797756+0000","last_undegraded":"2024-09-16T16:50:52.797756+0000","last_fullsized":"2024-09-16T16:50:52.797756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.064261+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:50:54.064261+0000","last_peered":"2024-09-16T16:50:54.064261+0000","last_clean":"2024-09-16T16:50:54.064261+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:50:54.064261+0000","last_undegraded":"2024-09-16T16:50:54.064261+0000","last_fullsized":"2024-09-16T16:50:54.064261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'82","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.374665+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:50:54.374665+0000","last_peered":"2024-09-16T16:50:54.374665+0000","last_clean":"2024-09-16T16:50:54.374665+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:50:54.374665+0000","last_undegraded":"2024-09-16T16:50:54.374665+0000","last_fullsized":"2024-09-16T16:50:54.374665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.262927+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:50:54.262927+0000","last_peered":"2024-09-16T16:50:54.262927+0000","last_clean":"2024-09-16T16:50:54.262927+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:50:54.262927+0000","last_undegraded":"2024-09-16T16:50:54.262927+0000","last_fullsized":"2024-09-16T16:50:54.262927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.850355+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:50:53.850355+0000","last_peered":"2024-09-16T16:50:53.850355+0000","last_clean":"2024-09-16T16:50:53.850355+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:50:53.850355+0000","last_undegraded":"2024-09-16T16:50:53.850355+0000","last_fullsized":"2024-09-16T16:50:53.850355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.800107+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:50:53.800107+0000","last_peered":"2024-09-16T16:50:53.800107+0000","last_clean":"2024-09-16T16:50:53.800107+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:50:53.800107+0000","last_undegraded":"2024-09-16T16:50:53.800107+0000","last_fullsized":"2024-09-16T16:50:53.800107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.919372+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:50:53.919372+0000","last_peered":"2024-09-16T16:50:53.919372+0000","last_clean":"2024-09-16T16:50:53.919372+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:50:53.919372+0000","last_undegraded":"2024-09-16T16:50:53.919372+0000","last_fullsized":"2024-09-16T16:50:53.919372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'104","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.371044+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:50:54.371044+0000","last_peered":"2024-09-16T16:50:54.371044+0000","last_clean":"2024-09-16T16:50:54.371044+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:50:54.371044+0000","last_undegraded":"2024-09-16T16:50:54.371044+0000","last_fullsized":"2024-09-16T16:50:54.371044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'88","reported_seq":100,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.108985+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:50:53.108985+0000","last_peered":"2024-09-16T16:50:53.108985+0000","last_clean":"2024-09-16T16:50:53.108985+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:50:53.108985+0000","last_undegraded":"2024-09-16T16:50:53.108985+0000","last_fullsized":"2024-09-16T16:50:53.108985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'128","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.119286+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:50:54.119286+0000","last_peered":"2024-09-16T16:50:54.119286+0000","last_clean":"2024-09-16T16:50:54.119286+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:50:54.119286+0000","last_undegraded":"2024-09-16T16:50:54.119286+0000","last_fullsized":"2024-09-16T16:50:54.119286+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":9650176,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1178,"ondisk_log_size":1178,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14748,"kb_used_data":14748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52282980,"statfs":{"total":53552873472,"available":53537771520,"internally_reserved":0,"allocated":15101952,"data_stored":15101952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17804,"kb_used_data":17804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52279924,"statfs":{"total":53552873472,"available":53534642176,"internally_reserved":0,"allocated":18231296,"data_stored":18231296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14600,"kb_used_data":14600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52283128,"statfs":{"total":53552873472,"available":53537923072,"internally_reserved":0,"allocated":14950400,"data_stored":14950400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":15916,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52281812,"statfs":{"total":53552873472,"available":53536575488,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:00.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1831 1815 0.88615 0.789062 0.0651258 0.140636 2024-09-16T16:51:01.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1954 1938 0.890543 0.960938 0.19401 0.139754 2024-09-16T16:51:01.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:01.556+0000 7fcf29f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:01.564+0000 7fcf29f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:02.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 2036 2020 0.876655 0.640625 0.129227 0.14134 2024-09-16T16:51:03.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 2113 2097 0.862174 0.601562 0.0381007 0.14399 2024-09-16T16:51:03.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:03.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:03.884+0000 7f04e4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:03.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:03.893+0000 7f04e4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:04.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:51:04.332025+0000 min lat: 0.0193148 max lat: 0.641305 avg lat: 0.144103 2024-09-16T16:51:04.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:51:04.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2220 2204 0.860858 0.835938 0.211265 0.144103 2024-09-16T16:51:04.602 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:04.603 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:04.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:04.756+0000 7f8892791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:04.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:04.772+0000 7f8892791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:05.084 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:51:05.085 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:51:05.103 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-16T16:51:04.412725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10240563,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1259,"num_write_kb":10532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1233,"ondisk_log_size":1233,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":63068,"kb_used_data":63068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209127844,"statfs":{"total":214211493888,"available":214146912256,"internally_reserved":0,"allocated":64581632,"data_stored":64581632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9650176,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002604"},"pg_stats":[{"pgid":"5.f","version":"40'48","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.005800+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:50:52.005800+0000","last_peered":"2024-09-16T16:50:52.005800+0000","last_clean":"2024-09-16T16:50:52.005800+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:50:52.005800+0000","last_undegraded":"2024-09-16T16:50:52.005800+0000","last_fullsized":"2024-09-16T16:50:52.005800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:50.800861+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:50:50.800861+0000","last_peered":"2024-09-16T16:50:50.800861+0000","last_clean":"2024-09-16T16:50:50.800861+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:50:50.800861+0000","last_undegraded":"2024-09-16T16:50:50.800861+0000","last_fullsized":"2024-09-16T16:50:50.800861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.197998+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:50:54.197998+0000","last_peered":"2024-09-16T16:50:54.197998+0000","last_clean":"2024-09-16T16:50:54.197998+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:50:54.197998+0000","last_undegraded":"2024-09-16T16:50:54.197998+0000","last_fullsized":"2024-09-16T16:50:54.197998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'136","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.561233+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:50:53.561233+0000","last_peered":"2024-09-16T16:50:53.561233+0000","last_clean":"2024-09-16T16:50:53.561233+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:50:53.561233+0000","last_undegraded":"2024-09-16T16:50:53.561233+0000","last_fullsized":"2024-09-16T16:50:53.561233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.716532+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:50:53.716532+0000","last_peered":"2024-09-16T16:50:53.716532+0000","last_clean":"2024-09-16T16:50:53.716532+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:50:53.716532+0000","last_undegraded":"2024-09-16T16:50:53.716532+0000","last_fullsized":"2024-09-16T16:50:53.716532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.097913+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:50:52.097913+0000","last_peered":"2024-09-16T16:50:52.097913+0000","last_clean":"2024-09-16T16:50:52.097913+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:50:52.097913+0000","last_undegraded":"2024-09-16T16:50:52.097913+0000","last_fullsized":"2024-09-16T16:50:52.097913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.797756+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:50:52.797756+0000","last_peered":"2024-09-16T16:50:52.797756+0000","last_clean":"2024-09-16T16:50:52.797756+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:50:52.797756+0000","last_undegraded":"2024-09-16T16:50:52.797756+0000","last_fullsized":"2024-09-16T16:50:52.797756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.064261+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:50:54.064261+0000","last_peered":"2024-09-16T16:50:54.064261+0000","last_clean":"2024-09-16T16:50:54.064261+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:50:54.064261+0000","last_undegraded":"2024-09-16T16:50:54.064261+0000","last_fullsized":"2024-09-16T16:50:54.064261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'82","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.374665+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:50:54.374665+0000","last_peered":"2024-09-16T16:50:54.374665+0000","last_clean":"2024-09-16T16:50:54.374665+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:50:54.374665+0000","last_undegraded":"2024-09-16T16:50:54.374665+0000","last_fullsized":"2024-09-16T16:50:54.374665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.262927+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:50:54.262927+0000","last_peered":"2024-09-16T16:50:54.262927+0000","last_clean":"2024-09-16T16:50:54.262927+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:50:54.262927+0000","last_undegraded":"2024-09-16T16:50:54.262927+0000","last_fullsized":"2024-09-16T16:50:54.262927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.850355+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:50:53.850355+0000","last_peered":"2024-09-16T16:50:53.850355+0000","last_clean":"2024-09-16T16:50:53.850355+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:50:53.850355+0000","last_undegraded":"2024-09-16T16:50:53.850355+0000","last_fullsized":"2024-09-16T16:50:53.850355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.800107+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:50:53.800107+0000","last_peered":"2024-09-16T16:50:53.800107+0000","last_clean":"2024-09-16T16:50:53.800107+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:50:53.800107+0000","last_undegraded":"2024-09-16T16:50:53.800107+0000","last_fullsized":"2024-09-16T16:50:53.800107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.919372+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:50:53.919372+0000","last_peered":"2024-09-16T16:50:53.919372+0000","last_clean":"2024-09-16T16:50:53.919372+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:50:53.919372+0000","last_undegraded":"2024-09-16T16:50:53.919372+0000","last_fullsized":"2024-09-16T16:50:53.919372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'104","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.371044+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:50:54.371044+0000","last_peered":"2024-09-16T16:50:54.371044+0000","last_clean":"2024-09-16T16:50:54.371044+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:50:54.371044+0000","last_undegraded":"2024-09-16T16:50:54.371044+0000","last_fullsized":"2024-09-16T16:50:54.371044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'88","reported_seq":100,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.108985+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:50:53.108985+0000","last_peered":"2024-09-16T16:50:53.108985+0000","last_clean":"2024-09-16T16:50:53.108985+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:50:53.108985+0000","last_undegraded":"2024-09-16T16:50:53.108985+0000","last_fullsized":"2024-09-16T16:50:53.108985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'128","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.119286+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:50:54.119286+0000","last_peered":"2024-09-16T16:50:54.119286+0000","last_clean":"2024-09-16T16:50:54.119286+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:50:54.119286+0000","last_undegraded":"2024-09-16T16:50:54.119286+0000","last_fullsized":"2024-09-16T16:50:54.119286+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":9650176,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1178,"ondisk_log_size":1178,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14748,"kb_used_data":14748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52282980,"statfs":{"total":53552873472,"available":53537771520,"internally_reserved":0,"allocated":15101952,"data_stored":15101952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17804,"kb_used_data":17804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52279924,"statfs":{"total":53552873472,"available":53534642176,"internally_reserved":0,"allocated":18231296,"data_stored":18231296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14600,"kb_used_data":14600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52283128,"statfs":{"total":53552873472,"available":53537923072,"internally_reserved":0,"allocated":14950400,"data_stored":14950400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":15916,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52281812,"statfs":{"total":53552873472,"available":53536575488,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:05.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 16 2319 2303 0.856692 0.773438 0.140207 0.145365 2024-09-16T16:51:06.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:06.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:06.319+0000 7fc5ef511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:06.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:06.328+0000 7fc5ef511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:06.331 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2438 2422 0.860006 0.929688 0.0665033 0.144988 2024-09-16T16:51:07.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2550 2534 0.860654 0.875 0.103335 0.144724 2024-09-16T16:51:08.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2668 2652 0.863201 0.921875 0.0500273 0.144262 2024-09-16T16:51:08.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:08.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:08.778+0000 7f5aec351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:08.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:08.788+0000 7f5aec351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:09.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2800 2784 0.86992 1.03125 0.117733 0.143197 2024-09-16T16:51:10.105 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:10.105 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:10.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:10.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:10.235+0000 7fc0d8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:10.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:10.246+0000 7fc0d8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:10.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 2898 2882 0.865905 0.765625 0.142568 0.143684 2024-09-16T16:51:10.472 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:51:10.473 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:51:10.489 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-16T16:51:10.413733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10240563,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1259,"num_write_kb":10532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1233,"ondisk_log_size":1233,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":63068,"kb_used_data":63068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209127844,"statfs":{"total":214211493888,"available":214146912256,"internally_reserved":0,"allocated":64581632,"data_stored":64581632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002421"},"pg_stats":[{"pgid":"5.f","version":"40'48","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.005800+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:50:52.005800+0000","last_peered":"2024-09-16T16:50:52.005800+0000","last_clean":"2024-09-16T16:50:52.005800+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:50:52.005800+0000","last_undegraded":"2024-09-16T16:50:52.005800+0000","last_fullsized":"2024-09-16T16:50:52.005800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:50.800861+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:50:50.800861+0000","last_peered":"2024-09-16T16:50:50.800861+0000","last_clean":"2024-09-16T16:50:50.800861+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:50:50.800861+0000","last_undegraded":"2024-09-16T16:50:50.800861+0000","last_fullsized":"2024-09-16T16:50:50.800861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.197998+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:50:54.197998+0000","last_peered":"2024-09-16T16:50:54.197998+0000","last_clean":"2024-09-16T16:50:54.197998+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:50:54.197998+0000","last_undegraded":"2024-09-16T16:50:54.197998+0000","last_fullsized":"2024-09-16T16:50:54.197998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'136","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.561233+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:50:53.561233+0000","last_peered":"2024-09-16T16:50:53.561233+0000","last_clean":"2024-09-16T16:50:53.561233+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:50:53.561233+0000","last_undegraded":"2024-09-16T16:50:53.561233+0000","last_fullsized":"2024-09-16T16:50:53.561233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.716532+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:50:53.716532+0000","last_peered":"2024-09-16T16:50:53.716532+0000","last_clean":"2024-09-16T16:50:53.716532+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:50:53.716532+0000","last_undegraded":"2024-09-16T16:50:53.716532+0000","last_fullsized":"2024-09-16T16:50:53.716532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.097913+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:50:52.097913+0000","last_peered":"2024-09-16T16:50:52.097913+0000","last_clean":"2024-09-16T16:50:52.097913+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:50:52.097913+0000","last_undegraded":"2024-09-16T16:50:52.097913+0000","last_fullsized":"2024-09-16T16:50:52.097913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.797756+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:50:52.797756+0000","last_peered":"2024-09-16T16:50:52.797756+0000","last_clean":"2024-09-16T16:50:52.797756+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:50:52.797756+0000","last_undegraded":"2024-09-16T16:50:52.797756+0000","last_fullsized":"2024-09-16T16:50:52.797756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.064261+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:50:54.064261+0000","last_peered":"2024-09-16T16:50:54.064261+0000","last_clean":"2024-09-16T16:50:54.064261+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:50:54.064261+0000","last_undegraded":"2024-09-16T16:50:54.064261+0000","last_fullsized":"2024-09-16T16:50:54.064261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'82","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.374665+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:50:54.374665+0000","last_peered":"2024-09-16T16:50:54.374665+0000","last_clean":"2024-09-16T16:50:54.374665+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:50:54.374665+0000","last_undegraded":"2024-09-16T16:50:54.374665+0000","last_fullsized":"2024-09-16T16:50:54.374665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.262927+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:50:54.262927+0000","last_peered":"2024-09-16T16:50:54.262927+0000","last_clean":"2024-09-16T16:50:54.262927+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:50:54.262927+0000","last_undegraded":"2024-09-16T16:50:54.262927+0000","last_fullsized":"2024-09-16T16:50:54.262927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.850355+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:50:53.850355+0000","last_peered":"2024-09-16T16:50:53.850355+0000","last_clean":"2024-09-16T16:50:53.850355+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:50:53.850355+0000","last_undegraded":"2024-09-16T16:50:53.850355+0000","last_fullsized":"2024-09-16T16:50:53.850355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.800107+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:50:53.800107+0000","last_peered":"2024-09-16T16:50:53.800107+0000","last_clean":"2024-09-16T16:50:53.800107+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:50:53.800107+0000","last_undegraded":"2024-09-16T16:50:53.800107+0000","last_fullsized":"2024-09-16T16:50:53.800107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.919372+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:50:53.919372+0000","last_peered":"2024-09-16T16:50:53.919372+0000","last_clean":"2024-09-16T16:50:53.919372+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:50:53.919372+0000","last_undegraded":"2024-09-16T16:50:53.919372+0000","last_fullsized":"2024-09-16T16:50:53.919372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'104","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.371044+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:50:54.371044+0000","last_peered":"2024-09-16T16:50:54.371044+0000","last_clean":"2024-09-16T16:50:54.371044+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:50:54.371044+0000","last_undegraded":"2024-09-16T16:50:54.371044+0000","last_fullsized":"2024-09-16T16:50:54.371044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'88","reported_seq":100,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.108985+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:50:53.108985+0000","last_peered":"2024-09-16T16:50:53.108985+0000","last_clean":"2024-09-16T16:50:53.108985+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:50:53.108985+0000","last_undegraded":"2024-09-16T16:50:53.108985+0000","last_fullsized":"2024-09-16T16:50:53.108985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'128","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.119286+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:50:54.119286+0000","last_peered":"2024-09-16T16:50:54.119286+0000","last_clean":"2024-09-16T16:50:54.119286+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:50:54.119286+0000","last_undegraded":"2024-09-16T16:50:54.119286+0000","last_fullsized":"2024-09-16T16:50:54.119286+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":9650176,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1178,"ondisk_log_size":1178,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14748,"kb_used_data":14748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52282980,"statfs":{"total":53552873472,"available":53537771520,"internally_reserved":0,"allocated":15101952,"data_stored":15101952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17804,"kb_used_data":17804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52279924,"statfs":{"total":53552873472,"available":53534642176,"internally_reserved":0,"allocated":18231296,"data_stored":18231296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14600,"kb_used_data":14600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52283128,"statfs":{"total":53552873472,"available":53537923072,"internally_reserved":0,"allocated":14950400,"data_stored":14950400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":15916,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52281812,"statfs":{"total":53552873472,"available":53536575488,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:10.958 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:11.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:11.075+0000 7f0288aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:11.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:11.083+0000 7f0288aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:11.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 3002 2986 0.863925 0.8125 0.133291 0.144279 2024-09-16T16:51:12.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 3107 3091 0.862364 0.820312 0.180299 0.144647 2024-09-16T16:51:13.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 3228 3212 0.865221 0.945312 0.110886 0.14404 2024-09-16T16:51:13.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:13.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:13.480+0000 7f77b1348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:13.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:13.488+0000 7f77b1348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:14.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 3321 3305 0.860598 0.726562 0.223955 0.144699 2024-09-16T16:51:15.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3410 3394 0.855264 0.695312 0.140537 0.145791 2024-09-16T16:51:15.491 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:15.491 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:15.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:15.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:15.614+0000 7f77edb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:15.623+0000 7f77edb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:15.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:51:15.834 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:51:15.850 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-16T16:51:14.414459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10240563,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1259,"num_write_kb":10532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1233,"ondisk_log_size":1233,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":63068,"kb_used_data":63068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209127844,"statfs":{"total":214211493888,"available":214146912256,"internally_reserved":0,"allocated":64581632,"data_stored":64581632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002183"},"pg_stats":[{"pgid":"5.f","version":"40'48","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.005800+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:50:52.005800+0000","last_peered":"2024-09-16T16:50:52.005800+0000","last_clean":"2024-09-16T16:50:52.005800+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:50:52.005800+0000","last_undegraded":"2024-09-16T16:50:52.005800+0000","last_fullsized":"2024-09-16T16:50:52.005800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:50.800861+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:50:50.800861+0000","last_peered":"2024-09-16T16:50:50.800861+0000","last_clean":"2024-09-16T16:50:50.800861+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:50:50.800861+0000","last_undegraded":"2024-09-16T16:50:50.800861+0000","last_fullsized":"2024-09-16T16:50:50.800861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.197998+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:50:54.197998+0000","last_peered":"2024-09-16T16:50:54.197998+0000","last_clean":"2024-09-16T16:50:54.197998+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:50:54.197998+0000","last_undegraded":"2024-09-16T16:50:54.197998+0000","last_fullsized":"2024-09-16T16:50:54.197998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'136","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.561233+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:50:53.561233+0000","last_peered":"2024-09-16T16:50:53.561233+0000","last_clean":"2024-09-16T16:50:53.561233+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:50:53.561233+0000","last_undegraded":"2024-09-16T16:50:53.561233+0000","last_fullsized":"2024-09-16T16:50:53.561233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.716532+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:50:53.716532+0000","last_peered":"2024-09-16T16:50:53.716532+0000","last_clean":"2024-09-16T16:50:53.716532+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:50:53.716532+0000","last_undegraded":"2024-09-16T16:50:53.716532+0000","last_fullsized":"2024-09-16T16:50:53.716532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.097913+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:50:52.097913+0000","last_peered":"2024-09-16T16:50:52.097913+0000","last_clean":"2024-09-16T16:50:52.097913+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:50:52.097913+0000","last_undegraded":"2024-09-16T16:50:52.097913+0000","last_fullsized":"2024-09-16T16:50:52.097913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.797756+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:50:52.797756+0000","last_peered":"2024-09-16T16:50:52.797756+0000","last_clean":"2024-09-16T16:50:52.797756+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:50:52.797756+0000","last_undegraded":"2024-09-16T16:50:52.797756+0000","last_fullsized":"2024-09-16T16:50:52.797756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.064261+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:50:54.064261+0000","last_peered":"2024-09-16T16:50:54.064261+0000","last_clean":"2024-09-16T16:50:54.064261+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:50:54.064261+0000","last_undegraded":"2024-09-16T16:50:54.064261+0000","last_fullsized":"2024-09-16T16:50:54.064261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'82","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.374665+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:50:54.374665+0000","last_peered":"2024-09-16T16:50:54.374665+0000","last_clean":"2024-09-16T16:50:54.374665+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:50:54.374665+0000","last_undegraded":"2024-09-16T16:50:54.374665+0000","last_fullsized":"2024-09-16T16:50:54.374665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.262927+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:50:54.262927+0000","last_peered":"2024-09-16T16:50:54.262927+0000","last_clean":"2024-09-16T16:50:54.262927+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:50:54.262927+0000","last_undegraded":"2024-09-16T16:50:54.262927+0000","last_fullsized":"2024-09-16T16:50:54.262927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.850355+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:50:53.850355+0000","last_peered":"2024-09-16T16:50:53.850355+0000","last_clean":"2024-09-16T16:50:53.850355+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:50:53.850355+0000","last_undegraded":"2024-09-16T16:50:53.850355+0000","last_fullsized":"2024-09-16T16:50:53.850355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.800107+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:50:53.800107+0000","last_peered":"2024-09-16T16:50:53.800107+0000","last_clean":"2024-09-16T16:50:53.800107+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:50:53.800107+0000","last_undegraded":"2024-09-16T16:50:53.800107+0000","last_fullsized":"2024-09-16T16:50:53.800107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.919372+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:50:53.919372+0000","last_peered":"2024-09-16T16:50:53.919372+0000","last_clean":"2024-09-16T16:50:53.919372+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:50:53.919372+0000","last_undegraded":"2024-09-16T16:50:53.919372+0000","last_fullsized":"2024-09-16T16:50:53.919372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'104","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.371044+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:50:54.371044+0000","last_peered":"2024-09-16T16:50:54.371044+0000","last_clean":"2024-09-16T16:50:54.371044+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:50:54.371044+0000","last_undegraded":"2024-09-16T16:50:54.371044+0000","last_fullsized":"2024-09-16T16:50:54.371044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'88","reported_seq":100,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.108985+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:50:53.108985+0000","last_peered":"2024-09-16T16:50:53.108985+0000","last_clean":"2024-09-16T16:50:53.108985+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:50:53.108985+0000","last_undegraded":"2024-09-16T16:50:53.108985+0000","last_fullsized":"2024-09-16T16:50:53.108985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'128","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.119286+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:50:54.119286+0000","last_peered":"2024-09-16T16:50:54.119286+0000","last_clean":"2024-09-16T16:50:54.119286+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:50:54.119286+0000","last_undegraded":"2024-09-16T16:50:54.119286+0000","last_fullsized":"2024-09-16T16:50:54.119286+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":9650176,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1178,"ondisk_log_size":1178,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14748,"kb_used_data":14748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52282980,"statfs":{"total":53552873472,"available":53537771520,"internally_reserved":0,"allocated":15101952,"data_stored":15101952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17804,"kb_used_data":17804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52279924,"statfs":{"total":53552873472,"available":53534642176,"internally_reserved":0,"allocated":18231296,"data_stored":18231296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14600,"kb_used_data":14600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52283128,"statfs":{"total":53552873472,"available":53537923072,"internally_reserved":0,"allocated":14950400,"data_stored":14950400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":15916,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52281812,"statfs":{"total":53552873472,"available":53536575488,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:15.859+0000 7f6920897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:15.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:15.866+0000 7f6920897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:16.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3504 3488 0.851484 0.734375 0.187552 0.14647 2024-09-16T16:51:17.332 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3621 3605 0.853378 0.914062 0.0921886 0.14608 2024-09-16T16:51:18.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:18.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:18.207+0000 7f519aa74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:18.219+0000 7f519aa74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:18.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3745 3729 0.856769 0.96875 0.104086 0.145617 2024-09-16T16:51:19.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 3873 3857 0.860858 1 0.0687579 0.144842 2024-09-16T16:51:20.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 3995 3979 0.863419 0.953125 0.11152 0.144308 2024-09-16T16:51:20.521 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:20.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:20.641+0000 7fc556e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:20.649+0000 7fc556e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:20.852 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:20.852 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:20.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:20.975+0000 7f7e6db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:20.987+0000 7f7e6db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:21.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 4107 4091 0.863729 0.875 0.174337 0.144433 2024-09-16T16:51:21.361 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:51:21.362 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:51:21.378 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-16T16:51:20.415721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10240563,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1259,"num_write_kb":10532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1233,"ondisk_log_size":1233,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":63068,"kb_used_data":63068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209127844,"statfs":{"total":214211493888,"available":214146912256,"internally_reserved":0,"allocated":64581632,"data_stored":64581632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002329"},"pg_stats":[{"pgid":"5.f","version":"40'48","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.005800+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:50:52.005800+0000","last_peered":"2024-09-16T16:50:52.005800+0000","last_clean":"2024-09-16T16:50:52.005800+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:50:52.005800+0000","last_undegraded":"2024-09-16T16:50:52.005800+0000","last_fullsized":"2024-09-16T16:50:52.005800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:50.800861+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:50:50.800861+0000","last_peered":"2024-09-16T16:50:50.800861+0000","last_clean":"2024-09-16T16:50:50.800861+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:50:50.800861+0000","last_undegraded":"2024-09-16T16:50:50.800861+0000","last_fullsized":"2024-09-16T16:50:50.800861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.197998+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:50:54.197998+0000","last_peered":"2024-09-16T16:50:54.197998+0000","last_clean":"2024-09-16T16:50:54.197998+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:50:54.197998+0000","last_undegraded":"2024-09-16T16:50:54.197998+0000","last_fullsized":"2024-09-16T16:50:54.197998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'136","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.561233+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:50:53.561233+0000","last_peered":"2024-09-16T16:50:53.561233+0000","last_clean":"2024-09-16T16:50:53.561233+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:50:53.561233+0000","last_undegraded":"2024-09-16T16:50:53.561233+0000","last_fullsized":"2024-09-16T16:50:53.561233+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.716532+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:50:53.716532+0000","last_peered":"2024-09-16T16:50:53.716532+0000","last_clean":"2024-09-16T16:50:53.716532+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:50:53.716532+0000","last_undegraded":"2024-09-16T16:50:53.716532+0000","last_fullsized":"2024-09-16T16:50:53.716532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.097913+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:50:52.097913+0000","last_peered":"2024-09-16T16:50:52.097913+0000","last_clean":"2024-09-16T16:50:52.097913+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:50:52.097913+0000","last_undegraded":"2024-09-16T16:50:52.097913+0000","last_fullsized":"2024-09-16T16:50:52.097913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:52.797756+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:50:52.797756+0000","last_peered":"2024-09-16T16:50:52.797756+0000","last_clean":"2024-09-16T16:50:52.797756+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:50:52.797756+0000","last_undegraded":"2024-09-16T16:50:52.797756+0000","last_fullsized":"2024-09-16T16:50:52.797756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'40","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.064261+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:50:54.064261+0000","last_peered":"2024-09-16T16:50:54.064261+0000","last_clean":"2024-09-16T16:50:54.064261+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:50:54.064261+0000","last_undegraded":"2024-09-16T16:50:54.064261+0000","last_fullsized":"2024-09-16T16:50:54.064261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'82","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.374665+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:50:54.374665+0000","last_peered":"2024-09-16T16:50:54.374665+0000","last_clean":"2024-09-16T16:50:54.374665+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:50:54.374665+0000","last_undegraded":"2024-09-16T16:50:54.374665+0000","last_fullsized":"2024-09-16T16:50:54.374665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671744,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.262927+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:50:54.262927+0000","last_peered":"2024-09-16T16:50:54.262927+0000","last_clean":"2024-09-16T16:50:54.262927+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:50:54.262927+0000","last_undegraded":"2024-09-16T16:50:54.262927+0000","last_fullsized":"2024-09-16T16:50:54.262927+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.850355+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:50:53.850355+0000","last_peered":"2024-09-16T16:50:53.850355+0000","last_clean":"2024-09-16T16:50:53.850355+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:50:53.850355+0000","last_undegraded":"2024-09-16T16:50:53.850355+0000","last_fullsized":"2024-09-16T16:50:53.850355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'56","reported_seq":68,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.800107+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:50:53.800107+0000","last_peered":"2024-09-16T16:50:53.800107+0000","last_clean":"2024-09-16T16:50:53.800107+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:50:53.800107+0000","last_undegraded":"2024-09-16T16:50:53.800107+0000","last_fullsized":"2024-09-16T16:50:53.800107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'72","reported_seq":84,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.919372+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:50:53.919372+0000","last_peered":"2024-09-16T16:50:53.919372+0000","last_clean":"2024-09-16T16:50:53.919372+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:50:53.919372+0000","last_undegraded":"2024-09-16T16:50:53.919372+0000","last_fullsized":"2024-09-16T16:50:53.919372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'104","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.371044+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:50:54.371044+0000","last_peered":"2024-09-16T16:50:54.371044+0000","last_clean":"2024-09-16T16:50:54.371044+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:50:54.371044+0000","last_undegraded":"2024-09-16T16:50:54.371044+0000","last_fullsized":"2024-09-16T16:50:54.371044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'88","reported_seq":100,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:53.108985+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:50:53.108985+0000","last_peered":"2024-09-16T16:50:53.108985+0000","last_clean":"2024-09-16T16:50:53.108985+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:50:53.108985+0000","last_undegraded":"2024-09-16T16:50:53.108985+0000","last_fullsized":"2024-09-16T16:50:53.108985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'128","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:54.119286+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:50:54.119286+0000","last_peered":"2024-09-16T16:50:54.119286+0000","last_clean":"2024-09-16T16:50:54.119286+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:50:54.119286+0000","last_undegraded":"2024-09-16T16:50:54.119286+0000","last_fullsized":"2024-09-16T16:50:54.119286+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":9650176,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1178,"ondisk_log_size":1178,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214144049152,"internally_reserved":0,"allocated":67444736,"data_stored":67444736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14748,"kb_used_data":14748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52282980,"statfs":{"total":53552873472,"available":53537771520,"internally_reserved":0,"allocated":15101952,"data_stored":15101952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17804,"kb_used_data":17804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52279924,"statfs":{"total":53552873472,"available":53534642176,"internally_reserved":0,"allocated":18231296,"data_stored":18231296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":14600,"kb_used_data":14600,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52283128,"statfs":{"total":53552873472,"available":53537923072,"internally_reserved":0,"allocated":14950400,"data_stored":14950400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":15916,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52281812,"statfs":{"total":53552873472,"available":53536575488,"internally_reserved":0,"allocated":16297984,"data_stored":16297984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53535158272,"internally_reserved":0,"allocated":17715200,"data_stored":17715200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53537906688,"internally_reserved":0,"allocated":14966784,"data_stored":14966784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53533245440,"internally_reserved":0,"allocated":19628032,"data_stored":19628032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53537738752,"internally_reserved":0,"allocated":15134720,"data_stored":15134720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:22.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 4191 4175 0.858267 0.65625 0.418032 0.145161 2024-09-16T16:51:22.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:22.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:22.982+0000 7f2d61a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:22.990+0000 7f2d61a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:23.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 4296 4280 0.857292 0.820312 0.102398 0.145527 2024-09-16T16:51:24.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:51:24.333915+0000 min lat: 0.0193148 max lat: 0.641305 avg lat: 0.145148 2024-09-16T16:51:24.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:51:24.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4415 4399 0.859099 0.929688 0.155382 0.145148 2024-09-16T16:51:25.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:25.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:25.283+0000 7f5731e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:25.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:25.291+0000 7f5731e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:25.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4520 4504 0.858151 0.820312 0.15042 0.145343 2024-09-16T16:51:26.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4641 4625 0.860224 0.945312 0.0754235 0.145079 2024-09-16T16:51:26.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:26.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:26.380 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:51:26.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:51:26.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:26.545+0000 7fb003948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:26.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:26.557+0000 7fb003948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:26.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:26.627 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:26.630 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:26.630 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:26.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:51:26.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:26.750+0000 7f0ede711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:26.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:26.762+0000 7f0ede711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:26.786 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:26.787 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:26.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:51:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:26.912+0000 7f5575111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:26.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:26.924+0000 7f5575111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:26.945 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:26.949 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:26.949 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:26.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:51:27.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:27.070+0000 7f5a8b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:27.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:27.081+0000 7f5a8b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:27.220 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:27.220 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:27.333 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4752 4736 0.860384 0.867188 0.153418 0.145051 2024-09-16T16:51:27.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:27.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:27.674+0000 7f0bcc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:27.682+0000 7f0bcc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:28.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 16 4853 4837 0.858761 0.789062 0.09449 0.145326 2024-09-16T16:51:29.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 4941 4925 0.854954 0.6875 0.224241 0.14565 2024-09-16T16:51:29.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:29.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:29.946+0000 7fb09bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:29.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:29.955+0000 7fb09bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:30.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 5035 5019 0.852331 0.734375 0.233623 0.146298 2024-09-16T16:51:31.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 16 5132 5116 0.850318 0.757812 0.119657 0.146786 2024-09-16T16:51:32.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:32.220 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:32.220 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:32.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:32.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:32.311+0000 7fac1e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:32.319+0000 7fac1e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:32.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 5248 5232 0.851482 0.90625 0.0501097 0.146407 2024-09-16T16:51:32.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:32.358+0000 7f4809391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:32.369+0000 7f4809391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:32.590 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:51:32.590 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:51:32.604 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-09-16T16:51:32.418104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36790835,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4500,"num_write_kb":36460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4474,"ondisk_log_size":4474,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":222380,"kb_used_data":222380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208968532,"statfs":{"total":214211493888,"available":213983776768,"internally_reserved":0,"allocated":227717120,"data_stored":227717120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26550272,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3241,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002383"},"pg_stats":[{"pgid":"5.f","version":"40'264","reported_seq":276,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:22.862891+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:51:22.862891+0000","last_peered":"2024-09-16T16:51:22.862891+0000","last_clean":"2024-09-16T16:51:22.862891+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:51:22.862891+0000","last_undegraded":"2024-09-16T16:51:22.862891+0000","last_fullsized":"2024-09-16T16:51:22.862891+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'216","reported_seq":228,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:22.215463+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:51:22.215463+0000","last_peered":"2024-09-16T16:51:22.215463+0000","last_clean":"2024-09-16T16:51:22.215463+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:51:22.215463+0000","last_undegraded":"2024-09-16T16:51:22.215463+0000","last_fullsized":"2024-09-16T16:51:22.215463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'299","reported_seq":311,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.370690+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:51:24.370690+0000","last_peered":"2024-09-16T16:51:24.370690+0000","last_clean":"2024-09-16T16:51:24.370690+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:51:24.370690+0000","last_undegraded":"2024-09-16T16:51:24.370690+0000","last_fullsized":"2024-09-16T16:51:24.370690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449408,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":2392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'296","reported_seq":308,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.334566+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:51:24.334566+0000","last_peered":"2024-09-16T16:51:24.334566+0000","last_clean":"2024-09-16T16:51:24.334566+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:51:24.334566+0000","last_undegraded":"2024-09-16T16:51:24.334566+0000","last_fullsized":"2024-09-16T16:51:24.334566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'352","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.680044+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:51:23.680044+0000","last_peered":"2024-09-16T16:51:23.680044+0000","last_clean":"2024-09-16T16:51:23.680044+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:51:23.680044+0000","last_undegraded":"2024-09-16T16:51:23.680044+0000","last_fullsized":"2024-09-16T16:51:23.680044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'248","reported_seq":260,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.415430+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:51:23.415430+0000","last_peered":"2024-09-16T16:51:23.415430+0000","last_clean":"2024-09-16T16:51:23.415430+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:51:23.415430+0000","last_undegraded":"2024-09-16T16:51:23.415430+0000","last_fullsized":"2024-09-16T16:51:23.415430+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'224","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.198061+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:51:24.198061+0000","last_peered":"2024-09-16T16:51:24.198061+0000","last_clean":"2024-09-16T16:51:24.198061+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:51:24.198061+0000","last_undegraded":"2024-09-16T16:51:24.198061+0000","last_fullsized":"2024-09-16T16:51:24.198061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'344","reported_seq":356,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.990820+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:51:23.990820+0000","last_peered":"2024-09-16T16:51:23.990820+0000","last_clean":"2024-09-16T16:51:23.990820+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:51:23.990820+0000","last_undegraded":"2024-09-16T16:51:23.990820+0000","last_fullsized":"2024-09-16T16:51:23.990820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'288","reported_seq":300,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.561648+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:51:23.561648+0000","last_peered":"2024-09-16T16:51:23.561648+0000","last_clean":"2024-09-16T16:51:23.561648+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:51:23.561648+0000","last_undegraded":"2024-09-16T16:51:23.561648+0000","last_fullsized":"2024-09-16T16:51:23.561648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'256","reported_seq":268,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.927348+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:51:23.927348+0000","last_peered":"2024-09-16T16:51:23.927348+0000","last_clean":"2024-09-16T16:51:23.927348+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:51:23.927348+0000","last_undegraded":"2024-09-16T16:51:23.927348+0000","last_fullsized":"2024-09-16T16:51:23.927348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'240","reported_seq":252,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:21.796721+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:51:21.796721+0000","last_peered":"2024-09-16T16:51:21.796721+0000","last_clean":"2024-09-16T16:51:21.796721+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:51:21.796721+0000","last_undegraded":"2024-09-16T16:51:21.796721+0000","last_fullsized":"2024-09-16T16:51:21.796721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'208","reported_seq":220,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.238628+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:51:24.238628+0000","last_peered":"2024-09-16T16:51:24.238628+0000","last_clean":"2024-09-16T16:51:24.238628+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:51:24.238628+0000","last_undegraded":"2024-09-16T16:51:24.238628+0000","last_fullsized":"2024-09-16T16:51:24.238628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'216","reported_seq":228,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.111074+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:51:24.111074+0000","last_peered":"2024-09-16T16:51:24.111074+0000","last_clean":"2024-09-16T16:51:24.111074+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:51:24.111074+0000","last_undegraded":"2024-09-16T16:51:24.111074+0000","last_fullsized":"2024-09-16T16:51:24.111074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'320","reported_seq":332,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:21.123171+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:51:21.123171+0000","last_peered":"2024-09-16T16:51:21.123171+0000","last_clean":"2024-09-16T16:51:21.123171+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:51:21.123171+0000","last_undegraded":"2024-09-16T16:51:21.123171+0000","last_fullsized":"2024-09-16T16:51:21.123171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'328","reported_seq":340,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.013331+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:51:24.013331+0000","last_peered":"2024-09-16T16:51:24.013331+0000","last_clean":"2024-09-16T16:51:24.013331+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:51:24.013331+0000","last_undegraded":"2024-09-16T16:51:24.013331+0000","last_fullsized":"2024-09-16T16:51:24.013331+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'320","reported_seq":332,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.209979+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:51:23.209979+0000","last_peered":"2024-09-16T16:51:23.209979+0000","last_clean":"2024-09-16T16:51:23.209979+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:51:23.209979+0000","last_undegraded":"2024-09-16T16:51:23.209979+0000","last_fullsized":"2024-09-16T16:51:23.209979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":36200448,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4419,"num_write_kb":35352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213980741632,"internally_reserved":0,"allocated":230752256,"data_stored":230752256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4419,"ondisk_log_size":4419,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213980823552,"internally_reserved":0,"allocated":230670336,"data_stored":230670336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":50816,"kb_used_data":50816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52246912,"statfs":{"total":53552873472,"available":53500837888,"internally_reserved":0,"allocated":52035584,"data_stored":52035584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":62252,"kb_used_data":62252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52235476,"statfs":{"total":53552873472,"available":53489127424,"internally_reserved":0,"allocated":63746048,"data_stored":63746048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":47420,"kb_used_data":47420,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52250308,"statfs":{"total":53552873472,"available":53504315392,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61892,"kb_used_data":61892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52235836,"statfs":{"total":53552873472,"available":53489496064,"internally_reserved":0,"allocated":63377408,"data_stored":63377408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53488361472,"internally_reserved":0,"allocated":64512000,"data_stored":64512000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53504315392,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53487415296,"internally_reserved":0,"allocated":65458176,"data_stored":65458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53488287744,"internally_reserved":0,"allocated":64585728,"data_stored":64585728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53504307200,"internally_reserved":0,"allocated":48566272,"data_stored":48566272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53487415296,"internally_reserved":0,"allocated":65458176,"data_stored":65458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:33.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 5357 5341 0.851482 0.851562 0.11567 0.146591 2024-09-16T16:51:34.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 5478 5462 0.853357 0.945312 0.0704362 0.146343 2024-09-16T16:51:34.565 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:34.714+0000 7f3aef68e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:34.722+0000 7f3aef68e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:35.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5575 5559 0.851482 0.757812 0.39732 0.146437 2024-09-16T16:51:36.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 16 5683 5667 0.851332 0.84375 0.0770138 0.146572 2024-09-16T16:51:37.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:37.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:37.214+0000 7f36b1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:37.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:37.227+0000 7f36b1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:37.334 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 5808 5792 0.853693 0.976562 0.109526 0.146217 2024-09-16T16:51:37.606 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:37.606 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:37.606 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:37.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:37.726+0000 7f5e1346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:37.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:37.737+0000 7f5e1346c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:37.968 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:51:37.969 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:51:37.984 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-16T16:51:36.418811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36790835,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4500,"num_write_kb":36460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4474,"ondisk_log_size":4474,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":222380,"kb_used_data":222380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208968532,"statfs":{"total":214211493888,"available":213983776768,"internally_reserved":0,"allocated":227717120,"data_stored":227717120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002336"},"pg_stats":[{"pgid":"5.f","version":"40'264","reported_seq":276,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:22.862891+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:51:22.862891+0000","last_peered":"2024-09-16T16:51:22.862891+0000","last_clean":"2024-09-16T16:51:22.862891+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:51:22.862891+0000","last_undegraded":"2024-09-16T16:51:22.862891+0000","last_fullsized":"2024-09-16T16:51:22.862891+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'216","reported_seq":228,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:22.215463+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:51:22.215463+0000","last_peered":"2024-09-16T16:51:22.215463+0000","last_clean":"2024-09-16T16:51:22.215463+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:51:22.215463+0000","last_undegraded":"2024-09-16T16:51:22.215463+0000","last_fullsized":"2024-09-16T16:51:22.215463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'299","reported_seq":311,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.370690+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:51:24.370690+0000","last_peered":"2024-09-16T16:51:24.370690+0000","last_clean":"2024-09-16T16:51:24.370690+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:51:24.370690+0000","last_undegraded":"2024-09-16T16:51:24.370690+0000","last_fullsized":"2024-09-16T16:51:24.370690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449408,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":2392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'296","reported_seq":308,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.334566+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:51:24.334566+0000","last_peered":"2024-09-16T16:51:24.334566+0000","last_clean":"2024-09-16T16:51:24.334566+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:51:24.334566+0000","last_undegraded":"2024-09-16T16:51:24.334566+0000","last_fullsized":"2024-09-16T16:51:24.334566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'352","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.680044+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:51:23.680044+0000","last_peered":"2024-09-16T16:51:23.680044+0000","last_clean":"2024-09-16T16:51:23.680044+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:51:23.680044+0000","last_undegraded":"2024-09-16T16:51:23.680044+0000","last_fullsized":"2024-09-16T16:51:23.680044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'248","reported_seq":260,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.415430+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:51:23.415430+0000","last_peered":"2024-09-16T16:51:23.415430+0000","last_clean":"2024-09-16T16:51:23.415430+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:51:23.415430+0000","last_undegraded":"2024-09-16T16:51:23.415430+0000","last_fullsized":"2024-09-16T16:51:23.415430+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'224","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.198061+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:51:24.198061+0000","last_peered":"2024-09-16T16:51:24.198061+0000","last_clean":"2024-09-16T16:51:24.198061+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:51:24.198061+0000","last_undegraded":"2024-09-16T16:51:24.198061+0000","last_fullsized":"2024-09-16T16:51:24.198061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'344","reported_seq":356,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.990820+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:51:23.990820+0000","last_peered":"2024-09-16T16:51:23.990820+0000","last_clean":"2024-09-16T16:51:23.990820+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:51:23.990820+0000","last_undegraded":"2024-09-16T16:51:23.990820+0000","last_fullsized":"2024-09-16T16:51:23.990820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'288","reported_seq":300,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.561648+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:51:23.561648+0000","last_peered":"2024-09-16T16:51:23.561648+0000","last_clean":"2024-09-16T16:51:23.561648+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:51:23.561648+0000","last_undegraded":"2024-09-16T16:51:23.561648+0000","last_fullsized":"2024-09-16T16:51:23.561648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'256","reported_seq":268,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.927348+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:51:23.927348+0000","last_peered":"2024-09-16T16:51:23.927348+0000","last_clean":"2024-09-16T16:51:23.927348+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:51:23.927348+0000","last_undegraded":"2024-09-16T16:51:23.927348+0000","last_fullsized":"2024-09-16T16:51:23.927348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'240","reported_seq":252,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:21.796721+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:51:21.796721+0000","last_peered":"2024-09-16T16:51:21.796721+0000","last_clean":"2024-09-16T16:51:21.796721+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:51:21.796721+0000","last_undegraded":"2024-09-16T16:51:21.796721+0000","last_fullsized":"2024-09-16T16:51:21.796721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'208","reported_seq":220,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.238628+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:51:24.238628+0000","last_peered":"2024-09-16T16:51:24.238628+0000","last_clean":"2024-09-16T16:51:24.238628+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:51:24.238628+0000","last_undegraded":"2024-09-16T16:51:24.238628+0000","last_fullsized":"2024-09-16T16:51:24.238628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'216","reported_seq":228,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.111074+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:51:24.111074+0000","last_peered":"2024-09-16T16:51:24.111074+0000","last_clean":"2024-09-16T16:51:24.111074+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:51:24.111074+0000","last_undegraded":"2024-09-16T16:51:24.111074+0000","last_fullsized":"2024-09-16T16:51:24.111074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'320","reported_seq":332,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:21.123171+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:51:21.123171+0000","last_peered":"2024-09-16T16:51:21.123171+0000","last_clean":"2024-09-16T16:51:21.123171+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:51:21.123171+0000","last_undegraded":"2024-09-16T16:51:21.123171+0000","last_fullsized":"2024-09-16T16:51:21.123171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'328","reported_seq":340,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.013331+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:51:24.013331+0000","last_peered":"2024-09-16T16:51:24.013331+0000","last_clean":"2024-09-16T16:51:24.013331+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:51:24.013331+0000","last_undegraded":"2024-09-16T16:51:24.013331+0000","last_fullsized":"2024-09-16T16:51:24.013331+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'320","reported_seq":332,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.209979+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:51:23.209979+0000","last_peered":"2024-09-16T16:51:23.209979+0000","last_clean":"2024-09-16T16:51:23.209979+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:51:23.209979+0000","last_undegraded":"2024-09-16T16:51:23.209979+0000","last_fullsized":"2024-09-16T16:51:23.209979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":36200448,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4419,"num_write_kb":35352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213980741632,"internally_reserved":0,"allocated":230752256,"data_stored":230752256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4419,"ondisk_log_size":4419,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213980823552,"internally_reserved":0,"allocated":230670336,"data_stored":230670336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":50816,"kb_used_data":50816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52246912,"statfs":{"total":53552873472,"available":53500837888,"internally_reserved":0,"allocated":52035584,"data_stored":52035584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":62252,"kb_used_data":62252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52235476,"statfs":{"total":53552873472,"available":53489127424,"internally_reserved":0,"allocated":63746048,"data_stored":63746048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":47420,"kb_used_data":47420,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52250308,"statfs":{"total":53552873472,"available":53504315392,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61892,"kb_used_data":61892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52235836,"statfs":{"total":53552873472,"available":53489496064,"internally_reserved":0,"allocated":63377408,"data_stored":63377408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53488361472,"internally_reserved":0,"allocated":64512000,"data_stored":64512000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53504315392,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53487415296,"internally_reserved":0,"allocated":65458176,"data_stored":65458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53488287744,"internally_reserved":0,"allocated":64585728,"data_stored":64585728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53504307200,"internally_reserved":0,"allocated":48566272,"data_stored":48566272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53487415296,"internally_reserved":0,"allocated":65458176,"data_stored":65458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:38.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 5920 5904 0.854086 0.875 0.121147 0.146063 2024-09-16T16:51:39.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 6021 6005 0.852902 0.789062 0.151637 0.146294 2024-09-16T16:51:39.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:39.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:39.648+0000 7f8550e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:39.657+0000 7f8550e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:40.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 6146 6130 0.855109 0.976562 0.0888173 0.145961 2024-09-16T16:51:41.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 6267 6251 0.85669 0.945312 0.188651 0.145763 2024-09-16T16:51:41.898 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:42.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:42.018+0000 7f7dca151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:42.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:42.031+0000 7f7dca151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:42.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 6366 6350 0.855253 0.773438 0.141764 0.14598 2024-09-16T16:51:42.986 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:42.986 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:42.986 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:51:42.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:51:43.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.132+0000 7f1a1d646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.145+0000 7f1a1d646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:43.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:43.212 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:43.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:51:43.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 6486 6470 0.856646 0.9375 0.218833 0.145742 2024-09-16T16:51:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.379+0000 7efcd2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.393+0000 7efcd2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.424 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:43.425 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:43.429 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:43.429 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:43.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:51:43.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.556+0000 7f5908b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.574+0000 7f5908b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:43.610 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:43.611 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:43.614 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:43.615 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:43.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:51:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.745+0000 7f1c46991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:43.764+0000 7f1c46991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:43.793 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:43.799 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:43.799 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:44.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:51:44.335871+0000 min lat: 0.0193148 max lat: 0.650877 avg lat: 0.145724 2024-09-16T16:51:44.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:51:44.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 6597 6581 0.85682 0.867188 0.118246 0.145724 2024-09-16T16:51:44.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:44.499+0000 7f29cf0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:44.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:44.507+0000 7f29cf0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:45.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 6706 6690 0.856733 0.851562 0.179718 0.145722 2024-09-16T16:51:46.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6801 6785 0.854884 0.742188 0.134653 0.145946 2024-09-16T16:51:46.679 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:46.800+0000 7f20c9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:46.808+0000 7f20c9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:47.335 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 6874 6858 0.850366 0.570312 0.131154 0.146664 2024-09-16T16:51:48.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 16 6949 6933 0.846233 0.585938 0.517567 0.147172 2024-09-16T16:51:48.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:48.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:48.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:51:48.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:48.914+0000 7f29bc86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:48.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:48.924+0000 7f29bc86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:48.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:49.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:49.070+0000 7fae7a26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:49.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:49.078+0000 7fae7a26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:49.133 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:51:49.134 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:51:49.148 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-16T16:51:48.421105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36790835,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4500,"num_write_kb":36460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4474,"ondisk_log_size":4474,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":222380,"kb_used_data":222380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208968532,"statfs":{"total":214211493888,"available":213983776768,"internally_reserved":0,"allocated":227717120,"data_stored":227717120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002293"},"pg_stats":[{"pgid":"5.f","version":"40'264","reported_seq":276,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:22.862891+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:51:22.862891+0000","last_peered":"2024-09-16T16:51:22.862891+0000","last_clean":"2024-09-16T16:51:22.862891+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:51:22.862891+0000","last_undegraded":"2024-09-16T16:51:22.862891+0000","last_fullsized":"2024-09-16T16:51:22.862891+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'216","reported_seq":228,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:22.215463+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:51:22.215463+0000","last_peered":"2024-09-16T16:51:22.215463+0000","last_clean":"2024-09-16T16:51:22.215463+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:51:22.215463+0000","last_undegraded":"2024-09-16T16:51:22.215463+0000","last_fullsized":"2024-09-16T16:51:22.215463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'299","reported_seq":311,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.370690+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:51:24.370690+0000","last_peered":"2024-09-16T16:51:24.370690+0000","last_clean":"2024-09-16T16:51:24.370690+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:51:24.370690+0000","last_undegraded":"2024-09-16T16:51:24.370690+0000","last_fullsized":"2024-09-16T16:51:24.370690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449408,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":2392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'296","reported_seq":308,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.334566+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:51:24.334566+0000","last_peered":"2024-09-16T16:51:24.334566+0000","last_clean":"2024-09-16T16:51:24.334566+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:51:24.334566+0000","last_undegraded":"2024-09-16T16:51:24.334566+0000","last_fullsized":"2024-09-16T16:51:24.334566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'352","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.680044+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:51:23.680044+0000","last_peered":"2024-09-16T16:51:23.680044+0000","last_clean":"2024-09-16T16:51:23.680044+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:51:23.680044+0000","last_undegraded":"2024-09-16T16:51:23.680044+0000","last_fullsized":"2024-09-16T16:51:23.680044+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'248","reported_seq":260,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.415430+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:51:23.415430+0000","last_peered":"2024-09-16T16:51:23.415430+0000","last_clean":"2024-09-16T16:51:23.415430+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:51:23.415430+0000","last_undegraded":"2024-09-16T16:51:23.415430+0000","last_fullsized":"2024-09-16T16:51:23.415430+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'224","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.198061+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:51:24.198061+0000","last_peered":"2024-09-16T16:51:24.198061+0000","last_clean":"2024-09-16T16:51:24.198061+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:51:24.198061+0000","last_undegraded":"2024-09-16T16:51:24.198061+0000","last_fullsized":"2024-09-16T16:51:24.198061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'344","reported_seq":356,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.990820+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:51:23.990820+0000","last_peered":"2024-09-16T16:51:23.990820+0000","last_clean":"2024-09-16T16:51:23.990820+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:51:23.990820+0000","last_undegraded":"2024-09-16T16:51:23.990820+0000","last_fullsized":"2024-09-16T16:51:23.990820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'288","reported_seq":300,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.561648+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:51:23.561648+0000","last_peered":"2024-09-16T16:51:23.561648+0000","last_clean":"2024-09-16T16:51:23.561648+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:51:23.561648+0000","last_undegraded":"2024-09-16T16:51:23.561648+0000","last_fullsized":"2024-09-16T16:51:23.561648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'256","reported_seq":268,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.927348+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:51:23.927348+0000","last_peered":"2024-09-16T16:51:23.927348+0000","last_clean":"2024-09-16T16:51:23.927348+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:51:23.927348+0000","last_undegraded":"2024-09-16T16:51:23.927348+0000","last_fullsized":"2024-09-16T16:51:23.927348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'240","reported_seq":252,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:21.796721+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:51:21.796721+0000","last_peered":"2024-09-16T16:51:21.796721+0000","last_clean":"2024-09-16T16:51:21.796721+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:51:21.796721+0000","last_undegraded":"2024-09-16T16:51:21.796721+0000","last_fullsized":"2024-09-16T16:51:21.796721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'208","reported_seq":220,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.238628+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:51:24.238628+0000","last_peered":"2024-09-16T16:51:24.238628+0000","last_clean":"2024-09-16T16:51:24.238628+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:51:24.238628+0000","last_undegraded":"2024-09-16T16:51:24.238628+0000","last_fullsized":"2024-09-16T16:51:24.238628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'216","reported_seq":228,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.111074+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:51:24.111074+0000","last_peered":"2024-09-16T16:51:24.111074+0000","last_clean":"2024-09-16T16:51:24.111074+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:51:24.111074+0000","last_undegraded":"2024-09-16T16:51:24.111074+0000","last_fullsized":"2024-09-16T16:51:24.111074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'320","reported_seq":332,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:21.123171+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:51:21.123171+0000","last_peered":"2024-09-16T16:51:21.123171+0000","last_clean":"2024-09-16T16:51:21.123171+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:51:21.123171+0000","last_undegraded":"2024-09-16T16:51:21.123171+0000","last_fullsized":"2024-09-16T16:51:21.123171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'328","reported_seq":340,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:24.013331+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:51:24.013331+0000","last_peered":"2024-09-16T16:51:24.013331+0000","last_clean":"2024-09-16T16:51:24.013331+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:51:24.013331+0000","last_undegraded":"2024-09-16T16:51:24.013331+0000","last_fullsized":"2024-09-16T16:51:24.013331+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'320","reported_seq":332,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:23.209979+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:51:23.209979+0000","last_peered":"2024-09-16T16:51:23.209979+0000","last_clean":"2024-09-16T16:51:23.209979+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:51:23.209979+0000","last_undegraded":"2024-09-16T16:51:23.209979+0000","last_fullsized":"2024-09-16T16:51:23.209979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":36200448,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4419,"num_write_kb":35352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213980741632,"internally_reserved":0,"allocated":230752256,"data_stored":230752256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4419,"ondisk_log_size":4419,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213980823552,"internally_reserved":0,"allocated":230670336,"data_stored":230670336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":50816,"kb_used_data":50816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52246912,"statfs":{"total":53552873472,"available":53500837888,"internally_reserved":0,"allocated":52035584,"data_stored":52035584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":62252,"kb_used_data":62252,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52235476,"statfs":{"total":53552873472,"available":53489127424,"internally_reserved":0,"allocated":63746048,"data_stored":63746048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":47420,"kb_used_data":47420,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52250308,"statfs":{"total":53552873472,"available":53504315392,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61892,"kb_used_data":61892,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52235836,"statfs":{"total":53552873472,"available":53489496064,"internally_reserved":0,"allocated":63377408,"data_stored":63377408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53488361472,"internally_reserved":0,"allocated":64512000,"data_stored":64512000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53504315392,"internally_reserved":0,"allocated":48558080,"data_stored":48558080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53487415296,"internally_reserved":0,"allocated":65458176,"data_stored":65458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53488287744,"internally_reserved":0,"allocated":64585728,"data_stored":64585728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53504307200,"internally_reserved":0,"allocated":48566272,"data_stored":48566272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53487415296,"internally_reserved":0,"allocated":65458176,"data_stored":65458176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53500731392,"internally_reserved":0,"allocated":52142080,"data_stored":52142080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:51:49.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 7015 6999 0.841146 0.515625 0.0533418 0.148288 2024-09-16T16:51:50.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 7105 7089 0.839054 0.703125 0.163559 0.148761 2024-09-16T16:51:51.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:51.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 7176 7160 0.834809 0.554688 0.108268 0.149643 2024-09-16T16:51:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:51.339+0000 7f78142fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:51.348+0000 7f78142fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:52.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 7270 7254 0.833331 0.734375 0.114157 0.149805 2024-09-16T16:51:53.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 16 7368 7352 0.832348 0.765625 0.0512257 0.149974 2024-09-16T16:51:53.654 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:53.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:53.775+0000 7f2040791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:53.784+0000 7f2040791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.150 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:54.150 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:54.150 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:51:54.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:51:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.296+0000 7f114b07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.307+0000 7f114b07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 7480 7464 0.832956 0.875 0.264188 0.149774 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:54.344 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:54.348 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:54.348 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:54.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:51:54.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.483+0000 7f09dff51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.495+0000 7f09dff51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:54.540 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:54.543 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:54.544 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:54.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:51:54.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.671+0000 7f34e1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.682+0000 7f34e1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:54.704 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:54.704 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:54.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:51:54.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.834+0000 7f59ba191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:54.849+0000 7f59ba191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:51:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:51:54.872 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:51:54.873 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:51:54.876 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:51:54.877 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:51:55.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 7573 7557 0.831457 0.726562 0.122242 0.150099 2024-09-16T16:51:56.085 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:51:56.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:56.238+0000 7f3027cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:56.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:56.247+0000 7f3027cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:56.336 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7664 7648 0.829782 0.710938 0.179376 0.150377 2024-09-16T16:51:57.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 7762 7746 0.828902 0.765625 0.0999368 0.150668 2024-09-16T16:51:58.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 7862 7846 0.828258 0.78125 0.0715942 0.150756 2024-09-16T16:51:58.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:51:58.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:58.625+0000 7f569b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:58.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:51:58.633+0000 7f569b311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:51:59.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 7974 7958 0.82888 0.875 0.0581014 0.150679 2024-09-16T16:51:59.878 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:51:59.878 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:51:59.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:00.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:00.017+0000 7f8730f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:00.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:00.028+0000 7f8730f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:00.320 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:52:00.320 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:52:00.335 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-16T16:51:58.423068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61891123,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7564,"num_write_kb":60972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7538,"ondisk_log_size":7538,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":373708,"kb_used_data":373708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208817204,"statfs":{"total":214211493888,"available":213828816896,"internally_reserved":0,"allocated":382676992,"data_stored":382676992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":24512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002328"},"pg_stats":[{"pgid":"5.f","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.809620+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:51:53.809620+0000","last_peered":"2024-09-16T16:51:53.809620+0000","last_clean":"2024-09-16T16:51:53.809620+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:51:53.809620+0000","last_undegraded":"2024-09-16T16:51:53.809620+0000","last_fullsized":"2024-09-16T16:51:53.809620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'392","reported_seq":404,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.230721+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:51:54.230721+0000","last_peered":"2024-09-16T16:51:54.230721+0000","last_clean":"2024-09-16T16:51:54.230721+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:51:54.230721+0000","last_undegraded":"2024-09-16T16:51:54.230721+0000","last_fullsized":"2024-09-16T16:51:54.230721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'520","reported_seq":532,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.402514+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:51:53.402514+0000","last_peered":"2024-09-16T16:51:53.402514+0000","last_clean":"2024-09-16T16:51:53.402514+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:51:53.402514+0000","last_undegraded":"2024-09-16T16:51:53.402514+0000","last_fullsized":"2024-09-16T16:51:53.402514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'504","reported_seq":516,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:45.986840+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:51:45.986840+0000","last_peered":"2024-09-16T16:51:45.986840+0000","last_clean":"2024-09-16T16:51:45.986840+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:51:45.986840+0000","last_undegraded":"2024-09-16T16:51:45.986840+0000","last_fullsized":"2024-09-16T16:51:45.986840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'496","reported_seq":508,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.726205+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:51:52.726205+0000","last_peered":"2024-09-16T16:51:52.726205+0000","last_clean":"2024-09-16T16:51:52.726205+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:51:52.726205+0000","last_undegraded":"2024-09-16T16:51:52.726205+0000","last_fullsized":"2024-09-16T16:51:52.726205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'464","reported_seq":476,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.108175+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:51:53.108175+0000","last_peered":"2024-09-16T16:51:53.108175+0000","last_clean":"2024-09-16T16:51:53.108175+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:51:53.108175+0000","last_undegraded":"2024-09-16T16:51:53.108175+0000","last_fullsized":"2024-09-16T16:51:53.108175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'403","reported_seq":415,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.389620+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:51:54.389620+0000","last_peered":"2024-09-16T16:51:54.389620+0000","last_clean":"2024-09-16T16:51:54.389620+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:51:54.389620+0000","last_undegraded":"2024-09-16T16:51:54.389620+0000","last_fullsized":"2024-09-16T16:51:54.389620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3301376,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":3224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'544","reported_seq":556,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.868306+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:51:53.868306+0000","last_peered":"2024-09-16T16:51:53.868306+0000","last_clean":"2024-09-16T16:51:53.868306+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:51:53.868306+0000","last_undegraded":"2024-09-16T16:51:53.868306+0000","last_fullsized":"2024-09-16T16:51:53.868306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.348114+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:51:54.348114+0000","last_peered":"2024-09-16T16:51:54.348114+0000","last_clean":"2024-09-16T16:51:54.348114+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:51:54.348114+0000","last_undegraded":"2024-09-16T16:51:54.348114+0000","last_fullsized":"2024-09-16T16:51:54.348114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'448","reported_seq":460,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.940912+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:51:53.940912+0000","last_peered":"2024-09-16T16:51:53.940912+0000","last_clean":"2024-09-16T16:51:53.940912+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:51:53.940912+0000","last_undegraded":"2024-09-16T16:51:53.940912+0000","last_fullsized":"2024-09-16T16:51:53.940912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'408","reported_seq":420,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.735974+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:51:53.735974+0000","last_peered":"2024-09-16T16:51:53.735974+0000","last_clean":"2024-09-16T16:51:53.735974+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:51:53.735974+0000","last_undegraded":"2024-09-16T16:51:53.735974+0000","last_fullsized":"2024-09-16T16:51:53.735974+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'352","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.590212+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:51:53.590212+0000","last_peered":"2024-09-16T16:51:53.590212+0000","last_clean":"2024-09-16T16:51:53.590212+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:51:53.590212+0000","last_undegraded":"2024-09-16T16:51:53.590212+0000","last_fullsized":"2024-09-16T16:51:53.590212+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'376","reported_seq":388,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.265973+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:51:53.265973+0000","last_peered":"2024-09-16T16:51:53.265973+0000","last_clean":"2024-09-16T16:51:53.265973+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:51:53.265973+0000","last_undegraded":"2024-09-16T16:51:53.265973+0000","last_fullsized":"2024-09-16T16:51:53.265973+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'568","reported_seq":580,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.632424+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:51:52.632424+0000","last_peered":"2024-09-16T16:51:52.632424+0000","last_clean":"2024-09-16T16:51:52.632424+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:51:52.632424+0000","last_undegraded":"2024-09-16T16:51:52.632424+0000","last_fullsized":"2024-09-16T16:51:52.632424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'576","reported_seq":588,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.139724+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:51:52.139724+0000","last_peered":"2024-09-16T16:51:52.139724+0000","last_clean":"2024-09-16T16:51:52.139724+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:51:52.139724+0000","last_undegraded":"2024-09-16T16:51:52.139724+0000","last_fullsized":"2024-09-16T16:51:52.139724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'488","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.458295+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:51:53.458295+0000","last_peered":"2024-09-16T16:51:53.458295+0000","last_clean":"2024-09-16T16:51:53.458295+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:51:53.458295+0000","last_undegraded":"2024-09-16T16:51:53.458295+0000","last_fullsized":"2024-09-16T16:51:53.458295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":61300736,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7483,"num_write_kb":59864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823983616,"internally_reserved":0,"allocated":387510272,"data_stored":387510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7483,"ondisk_log_size":7483,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823991808,"internally_reserved":0,"allocated":387502080,"data_stored":387502080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":85908,"kb_used_data":85908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52211820,"statfs":{"total":53552873472,"available":53464903680,"internally_reserved":0,"allocated":87969792,"data_stored":87969792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":106868,"kb_used_data":106868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52190860,"statfs":{"total":53552873472,"available":53443440640,"internally_reserved":0,"allocated":109432832,"data_stored":109432832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76876,"kb_used_data":76876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220852,"statfs":{"total":53552873472,"available":53474152448,"internally_reserved":0,"allocated":78721024,"data_stored":78721024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":104056,"kb_used_data":104056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193672,"statfs":{"total":53552873472,"available":53446320128,"internally_reserved":0,"allocated":106553344,"data_stored":106553344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53442023424,"internally_reserved":0,"allocated":110850048,"data_stored":110850048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53442015232,"internally_reserved":0,"allocated":110858240,"data_stored":110858240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:00.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 8086 8070 0.829485 0.875 0.0844755 0.150566 2024-09-16T16:52:00.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:01.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:01.066+0000 7f9ba1951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:01.074+0000 7f9ba1951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:01.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 8193 8177 0.829568 0.835938 0.135185 0.150505 2024-09-16T16:52:02.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 8314 8298 0.831051 0.945312 0.0699107 0.150238 2024-09-16T16:52:03.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:03.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 8424 8408 0.831408 0.859375 0.150228 0.150145 2024-09-16T16:52:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:03.441+0000 7f22f5351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:03.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:03.449+0000 7f22f5351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:04.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:52:04.337763+0000 min lat: 0.0193148 max lat: 0.935158 avg lat: 0.150244 2024-09-16T16:52:04.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:52:04.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 8522 8506 0.830585 0.765625 0.19757 0.150244 2024-09-16T16:52:05.337 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:05.337 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:05.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:05.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 8622 8606 0.829975 0.78125 0.157649 0.150444 2024-09-16T16:52:05.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:05.490+0000 7f0450911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:05.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:05.503+0000 7f0450911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:05.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:52:05.732 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:52:05.749 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-16T16:52:04.424344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61891123,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7564,"num_write_kb":60972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7538,"ondisk_log_size":7538,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":373708,"kb_used_data":373708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208817204,"statfs":{"total":214211493888,"available":213828816896,"internally_reserved":0,"allocated":382676992,"data_stored":382676992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":24512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002434"},"pg_stats":[{"pgid":"5.f","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.809620+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:51:53.809620+0000","last_peered":"2024-09-16T16:51:53.809620+0000","last_clean":"2024-09-16T16:51:53.809620+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:51:53.809620+0000","last_undegraded":"2024-09-16T16:51:53.809620+0000","last_fullsized":"2024-09-16T16:51:53.809620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'392","reported_seq":404,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.230721+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:51:54.230721+0000","last_peered":"2024-09-16T16:51:54.230721+0000","last_clean":"2024-09-16T16:51:54.230721+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:51:54.230721+0000","last_undegraded":"2024-09-16T16:51:54.230721+0000","last_fullsized":"2024-09-16T16:51:54.230721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'520","reported_seq":532,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.402514+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:51:53.402514+0000","last_peered":"2024-09-16T16:51:53.402514+0000","last_clean":"2024-09-16T16:51:53.402514+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:51:53.402514+0000","last_undegraded":"2024-09-16T16:51:53.402514+0000","last_fullsized":"2024-09-16T16:51:53.402514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'504","reported_seq":516,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:45.986840+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:51:45.986840+0000","last_peered":"2024-09-16T16:51:45.986840+0000","last_clean":"2024-09-16T16:51:45.986840+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:51:45.986840+0000","last_undegraded":"2024-09-16T16:51:45.986840+0000","last_fullsized":"2024-09-16T16:51:45.986840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'496","reported_seq":508,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.726205+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:51:52.726205+0000","last_peered":"2024-09-16T16:51:52.726205+0000","last_clean":"2024-09-16T16:51:52.726205+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:51:52.726205+0000","last_undegraded":"2024-09-16T16:51:52.726205+0000","last_fullsized":"2024-09-16T16:51:52.726205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'464","reported_seq":476,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.108175+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:51:53.108175+0000","last_peered":"2024-09-16T16:51:53.108175+0000","last_clean":"2024-09-16T16:51:53.108175+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:51:53.108175+0000","last_undegraded":"2024-09-16T16:51:53.108175+0000","last_fullsized":"2024-09-16T16:51:53.108175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'403","reported_seq":415,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.389620+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:51:54.389620+0000","last_peered":"2024-09-16T16:51:54.389620+0000","last_clean":"2024-09-16T16:51:54.389620+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:51:54.389620+0000","last_undegraded":"2024-09-16T16:51:54.389620+0000","last_fullsized":"2024-09-16T16:51:54.389620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3301376,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":3224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'544","reported_seq":556,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.868306+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:51:53.868306+0000","last_peered":"2024-09-16T16:51:53.868306+0000","last_clean":"2024-09-16T16:51:53.868306+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:51:53.868306+0000","last_undegraded":"2024-09-16T16:51:53.868306+0000","last_fullsized":"2024-09-16T16:51:53.868306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.348114+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:51:54.348114+0000","last_peered":"2024-09-16T16:51:54.348114+0000","last_clean":"2024-09-16T16:51:54.348114+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:51:54.348114+0000","last_undegraded":"2024-09-16T16:51:54.348114+0000","last_fullsized":"2024-09-16T16:51:54.348114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'448","reported_seq":460,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.940912+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:51:53.940912+0000","last_peered":"2024-09-16T16:51:53.940912+0000","last_clean":"2024-09-16T16:51:53.940912+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:51:53.940912+0000","last_undegraded":"2024-09-16T16:51:53.940912+0000","last_fullsized":"2024-09-16T16:51:53.940912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'408","reported_seq":420,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.735974+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:51:53.735974+0000","last_peered":"2024-09-16T16:51:53.735974+0000","last_clean":"2024-09-16T16:51:53.735974+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:51:53.735974+0000","last_undegraded":"2024-09-16T16:51:53.735974+0000","last_fullsized":"2024-09-16T16:51:53.735974+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'352","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.590212+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:51:53.590212+0000","last_peered":"2024-09-16T16:51:53.590212+0000","last_clean":"2024-09-16T16:51:53.590212+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:51:53.590212+0000","last_undegraded":"2024-09-16T16:51:53.590212+0000","last_fullsized":"2024-09-16T16:51:53.590212+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'376","reported_seq":388,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.265973+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:51:53.265973+0000","last_peered":"2024-09-16T16:51:53.265973+0000","last_clean":"2024-09-16T16:51:53.265973+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:51:53.265973+0000","last_undegraded":"2024-09-16T16:51:53.265973+0000","last_fullsized":"2024-09-16T16:51:53.265973+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'568","reported_seq":580,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.632424+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:51:52.632424+0000","last_peered":"2024-09-16T16:51:52.632424+0000","last_clean":"2024-09-16T16:51:52.632424+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:51:52.632424+0000","last_undegraded":"2024-09-16T16:51:52.632424+0000","last_fullsized":"2024-09-16T16:51:52.632424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'576","reported_seq":588,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.139724+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:51:52.139724+0000","last_peered":"2024-09-16T16:51:52.139724+0000","last_clean":"2024-09-16T16:51:52.139724+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:51:52.139724+0000","last_undegraded":"2024-09-16T16:51:52.139724+0000","last_fullsized":"2024-09-16T16:51:52.139724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'488","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.458295+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:51:53.458295+0000","last_peered":"2024-09-16T16:51:53.458295+0000","last_clean":"2024-09-16T16:51:53.458295+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:51:53.458295+0000","last_undegraded":"2024-09-16T16:51:53.458295+0000","last_fullsized":"2024-09-16T16:51:53.458295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":61300736,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7483,"num_write_kb":59864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823983616,"internally_reserved":0,"allocated":387510272,"data_stored":387510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7483,"ondisk_log_size":7483,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823991808,"internally_reserved":0,"allocated":387502080,"data_stored":387502080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":85908,"kb_used_data":85908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52211820,"statfs":{"total":53552873472,"available":53464903680,"internally_reserved":0,"allocated":87969792,"data_stored":87969792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":106868,"kb_used_data":106868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52190860,"statfs":{"total":53552873472,"available":53443440640,"internally_reserved":0,"allocated":109432832,"data_stored":109432832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76876,"kb_used_data":76876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220852,"statfs":{"total":53552873472,"available":53474152448,"internally_reserved":0,"allocated":78721024,"data_stored":78721024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":104056,"kb_used_data":104056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193672,"statfs":{"total":53552873472,"available":53446320128,"internally_reserved":0,"allocated":106553344,"data_stored":106553344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53442023424,"internally_reserved":0,"allocated":110850048,"data_stored":110850048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53442015232,"internally_reserved":0,"allocated":110858240,"data_stored":110858240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:05.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:05.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:05.933+0000 7f1fe2efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:05.940+0000 7f1fe2efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:06.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 16 8718 8702 0.828999 0.75 0.115051 0.150627 2024-09-16T16:52:07.337 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 8808 8792 0.827482 0.703125 0.0654803 0.150857 2024-09-16T16:52:08.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:08.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 8914 8898 0.827489 0.828125 0.292731 0.150821 2024-09-16T16:52:08.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:08.428+0000 7fe24b07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:08.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:08.437+0000 7fe24b07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:09.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 9009 8993 0.826485 0.742188 0.11721 0.151065 2024-09-16T16:52:10.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 9118 9102 0.826775 0.851562 0.138185 0.151009 2024-09-16T16:52:10.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:10.751 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:10.752 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:10.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:10.797+0000 7f145a8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:10.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:10.809+0000 7f145a8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:10.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:10.910+0000 7f0697151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:10.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:10.921+0000 7f0697151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:52:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:52:11.169 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-16T16:52:10.425367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61891123,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7564,"num_write_kb":60972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7538,"ondisk_log_size":7538,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":373708,"kb_used_data":373708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208817204,"statfs":{"total":214211493888,"available":213828816896,"internally_reserved":0,"allocated":382676992,"data_stored":382676992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002299"},"pg_stats":[{"pgid":"5.f","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.809620+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:51:53.809620+0000","last_peered":"2024-09-16T16:51:53.809620+0000","last_clean":"2024-09-16T16:51:53.809620+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:51:53.809620+0000","last_undegraded":"2024-09-16T16:51:53.809620+0000","last_fullsized":"2024-09-16T16:51:53.809620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'392","reported_seq":404,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.230721+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:51:54.230721+0000","last_peered":"2024-09-16T16:51:54.230721+0000","last_clean":"2024-09-16T16:51:54.230721+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:51:54.230721+0000","last_undegraded":"2024-09-16T16:51:54.230721+0000","last_fullsized":"2024-09-16T16:51:54.230721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'520","reported_seq":532,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.402514+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:51:53.402514+0000","last_peered":"2024-09-16T16:51:53.402514+0000","last_clean":"2024-09-16T16:51:53.402514+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:51:53.402514+0000","last_undegraded":"2024-09-16T16:51:53.402514+0000","last_fullsized":"2024-09-16T16:51:53.402514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'504","reported_seq":516,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:45.986840+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:51:45.986840+0000","last_peered":"2024-09-16T16:51:45.986840+0000","last_clean":"2024-09-16T16:51:45.986840+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:51:45.986840+0000","last_undegraded":"2024-09-16T16:51:45.986840+0000","last_fullsized":"2024-09-16T16:51:45.986840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'496","reported_seq":508,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.726205+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:51:52.726205+0000","last_peered":"2024-09-16T16:51:52.726205+0000","last_clean":"2024-09-16T16:51:52.726205+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:51:52.726205+0000","last_undegraded":"2024-09-16T16:51:52.726205+0000","last_fullsized":"2024-09-16T16:51:52.726205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'464","reported_seq":476,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.108175+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:51:53.108175+0000","last_peered":"2024-09-16T16:51:53.108175+0000","last_clean":"2024-09-16T16:51:53.108175+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:51:53.108175+0000","last_undegraded":"2024-09-16T16:51:53.108175+0000","last_fullsized":"2024-09-16T16:51:53.108175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'403","reported_seq":415,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.389620+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:51:54.389620+0000","last_peered":"2024-09-16T16:51:54.389620+0000","last_clean":"2024-09-16T16:51:54.389620+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:51:54.389620+0000","last_undegraded":"2024-09-16T16:51:54.389620+0000","last_fullsized":"2024-09-16T16:51:54.389620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3301376,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":3224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'544","reported_seq":556,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.868306+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:51:53.868306+0000","last_peered":"2024-09-16T16:51:53.868306+0000","last_clean":"2024-09-16T16:51:53.868306+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:51:53.868306+0000","last_undegraded":"2024-09-16T16:51:53.868306+0000","last_fullsized":"2024-09-16T16:51:53.868306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.348114+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:51:54.348114+0000","last_peered":"2024-09-16T16:51:54.348114+0000","last_clean":"2024-09-16T16:51:54.348114+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:51:54.348114+0000","last_undegraded":"2024-09-16T16:51:54.348114+0000","last_fullsized":"2024-09-16T16:51:54.348114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'448","reported_seq":460,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.940912+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:51:53.940912+0000","last_peered":"2024-09-16T16:51:53.940912+0000","last_clean":"2024-09-16T16:51:53.940912+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:51:53.940912+0000","last_undegraded":"2024-09-16T16:51:53.940912+0000","last_fullsized":"2024-09-16T16:51:53.940912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'408","reported_seq":420,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.735974+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:51:53.735974+0000","last_peered":"2024-09-16T16:51:53.735974+0000","last_clean":"2024-09-16T16:51:53.735974+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:51:53.735974+0000","last_undegraded":"2024-09-16T16:51:53.735974+0000","last_fullsized":"2024-09-16T16:51:53.735974+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'352","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.590212+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:51:53.590212+0000","last_peered":"2024-09-16T16:51:53.590212+0000","last_clean":"2024-09-16T16:51:53.590212+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:51:53.590212+0000","last_undegraded":"2024-09-16T16:51:53.590212+0000","last_fullsized":"2024-09-16T16:51:53.590212+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'376","reported_seq":388,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.265973+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:51:53.265973+0000","last_peered":"2024-09-16T16:51:53.265973+0000","last_clean":"2024-09-16T16:51:53.265973+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:51:53.265973+0000","last_undegraded":"2024-09-16T16:51:53.265973+0000","last_fullsized":"2024-09-16T16:51:53.265973+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'568","reported_seq":580,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.632424+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:51:52.632424+0000","last_peered":"2024-09-16T16:51:52.632424+0000","last_clean":"2024-09-16T16:51:52.632424+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:51:52.632424+0000","last_undegraded":"2024-09-16T16:51:52.632424+0000","last_fullsized":"2024-09-16T16:51:52.632424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'576","reported_seq":588,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.139724+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:51:52.139724+0000","last_peered":"2024-09-16T16:51:52.139724+0000","last_clean":"2024-09-16T16:51:52.139724+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:51:52.139724+0000","last_undegraded":"2024-09-16T16:51:52.139724+0000","last_fullsized":"2024-09-16T16:51:52.139724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'488","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.458295+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:51:53.458295+0000","last_peered":"2024-09-16T16:51:53.458295+0000","last_clean":"2024-09-16T16:51:53.458295+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:51:53.458295+0000","last_undegraded":"2024-09-16T16:51:53.458295+0000","last_fullsized":"2024-09-16T16:51:53.458295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":61300736,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7483,"num_write_kb":59864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823983616,"internally_reserved":0,"allocated":387510272,"data_stored":387510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7483,"ondisk_log_size":7483,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823991808,"internally_reserved":0,"allocated":387502080,"data_stored":387502080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":85908,"kb_used_data":85908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52211820,"statfs":{"total":53552873472,"available":53464903680,"internally_reserved":0,"allocated":87969792,"data_stored":87969792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":106868,"kb_used_data":106868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52190860,"statfs":{"total":53552873472,"available":53443440640,"internally_reserved":0,"allocated":109432832,"data_stored":109432832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76876,"kb_used_data":76876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220852,"statfs":{"total":53552873472,"available":53474152448,"internally_reserved":0,"allocated":78721024,"data_stored":78721024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":104056,"kb_used_data":104056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193672,"statfs":{"total":53552873472,"available":53446320128,"internally_reserved":0,"allocated":106553344,"data_stored":106553344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53442023424,"internally_reserved":0,"allocated":110850048,"data_stored":110850048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53442015232,"internally_reserved":0,"allocated":110858240,"data_stored":110858240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:11.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 9219 9203 0.826341 0.789062 0.146751 0.151119 2024-09-16T16:52:12.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 16 9325 9309 0.82636 0.828125 0.133209 0.15115 2024-09-16T16:52:13.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:13.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:13.211+0000 7fa241151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:13.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:13.218+0000 7fa241151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:13.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 9438 9422 0.826994 0.882812 0.173859 0.150951 2024-09-16T16:52:14.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 16 9541 9525 0.826745 0.804688 0.134016 0.151063 2024-09-16T16:52:15.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.1113 2024-09-16T16:52:15.338 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 9541 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.827189 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.114696 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 1.14844 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.515625 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 105 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 14.6811 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 147 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 66 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.151021 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.0877819 2024-09-16T16:52:15.339 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 0.935158 2024-09-16T16:52:15.340 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0193148 2024-09-16T16:52:15.385 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:52:15.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:15.608+0000 7fafdf8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:15.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:15.617+0000 7fafdf8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.171 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:16.172 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:16.172 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:52:16.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:52:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:16.352+0000 7f5bb0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:16.367+0000 7f5bb0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.446 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:16.446 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:16.446 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:16.446 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:16.447 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:16.451 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:16.451 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:16.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:52:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:16.622+0000 7fe37ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:16.642+0000 7fe37ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:16.721 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:16.722 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:16.722 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:52:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:16.873+0000 7f5fd1ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:16.887+0000 7f5fd1ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:16.905 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:16.905 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:16.905 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:16.905 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:16.906 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:16.910 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:16.911 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:16.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:52:17.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:17.042+0000 7fd3ba791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:17.059+0000 7fd3ba791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:17.145 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:17.148 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:17.149 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:17.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:18.092+0000 7fa558991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:18.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:18.101+0000 7fa558991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:20.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:20.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:20.583+0000 7f566f0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:20.591+0000 7f566f0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:22.149 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:22.150 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:22.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:22.277+0000 7fc663874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:22.287+0000 7fc663874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:22.624 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:52:22.625 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:52:22.650 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-16T16:52:22.427635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61891123,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7564,"num_write_kb":60972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7538,"ondisk_log_size":7538,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":373708,"kb_used_data":373708,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208817204,"statfs":{"total":214211493888,"available":213828816896,"internally_reserved":0,"allocated":382676992,"data_stored":382676992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002267"},"pg_stats":[{"pgid":"5.f","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.809620+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:51:53.809620+0000","last_peered":"2024-09-16T16:51:53.809620+0000","last_clean":"2024-09-16T16:51:53.809620+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:51:53.809620+0000","last_undegraded":"2024-09-16T16:51:53.809620+0000","last_fullsized":"2024-09-16T16:51:53.809620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'392","reported_seq":404,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.230721+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:51:54.230721+0000","last_peered":"2024-09-16T16:51:54.230721+0000","last_clean":"2024-09-16T16:51:54.230721+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:51:54.230721+0000","last_undegraded":"2024-09-16T16:51:54.230721+0000","last_fullsized":"2024-09-16T16:51:54.230721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'520","reported_seq":532,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.402514+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:51:53.402514+0000","last_peered":"2024-09-16T16:51:53.402514+0000","last_clean":"2024-09-16T16:51:53.402514+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:51:53.402514+0000","last_undegraded":"2024-09-16T16:51:53.402514+0000","last_fullsized":"2024-09-16T16:51:53.402514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'504","reported_seq":516,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:45.986840+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:51:45.986840+0000","last_peered":"2024-09-16T16:51:45.986840+0000","last_clean":"2024-09-16T16:51:45.986840+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:51:45.986840+0000","last_undegraded":"2024-09-16T16:51:45.986840+0000","last_fullsized":"2024-09-16T16:51:45.986840+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'496","reported_seq":508,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.726205+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:51:52.726205+0000","last_peered":"2024-09-16T16:51:52.726205+0000","last_clean":"2024-09-16T16:51:52.726205+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:51:52.726205+0000","last_undegraded":"2024-09-16T16:51:52.726205+0000","last_fullsized":"2024-09-16T16:51:52.726205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'464","reported_seq":476,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.108175+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:51:53.108175+0000","last_peered":"2024-09-16T16:51:53.108175+0000","last_clean":"2024-09-16T16:51:53.108175+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:51:53.108175+0000","last_undegraded":"2024-09-16T16:51:53.108175+0000","last_fullsized":"2024-09-16T16:51:53.108175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'403","reported_seq":415,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.389620+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:51:54.389620+0000","last_peered":"2024-09-16T16:51:54.389620+0000","last_clean":"2024-09-16T16:51:54.389620+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:51:54.389620+0000","last_undegraded":"2024-09-16T16:51:54.389620+0000","last_fullsized":"2024-09-16T16:51:54.389620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3301376,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":3224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'544","reported_seq":556,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.868306+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:51:53.868306+0000","last_peered":"2024-09-16T16:51:53.868306+0000","last_clean":"2024-09-16T16:51:53.868306+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:51:53.868306+0000","last_undegraded":"2024-09-16T16:51:53.868306+0000","last_fullsized":"2024-09-16T16:51:53.868306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'472","reported_seq":484,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:54.348114+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:51:54.348114+0000","last_peered":"2024-09-16T16:51:54.348114+0000","last_clean":"2024-09-16T16:51:54.348114+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:51:54.348114+0000","last_undegraded":"2024-09-16T16:51:54.348114+0000","last_fullsized":"2024-09-16T16:51:54.348114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'448","reported_seq":460,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.940912+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:51:53.940912+0000","last_peered":"2024-09-16T16:51:53.940912+0000","last_clean":"2024-09-16T16:51:53.940912+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:51:53.940912+0000","last_undegraded":"2024-09-16T16:51:53.940912+0000","last_fullsized":"2024-09-16T16:51:53.940912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'408","reported_seq":420,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.735974+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:51:53.735974+0000","last_peered":"2024-09-16T16:51:53.735974+0000","last_clean":"2024-09-16T16:51:53.735974+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:51:53.735974+0000","last_undegraded":"2024-09-16T16:51:53.735974+0000","last_fullsized":"2024-09-16T16:51:53.735974+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'352","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.590212+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:51:53.590212+0000","last_peered":"2024-09-16T16:51:53.590212+0000","last_clean":"2024-09-16T16:51:53.590212+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:51:53.590212+0000","last_undegraded":"2024-09-16T16:51:53.590212+0000","last_fullsized":"2024-09-16T16:51:53.590212+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'376","reported_seq":388,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.265973+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:51:53.265973+0000","last_peered":"2024-09-16T16:51:53.265973+0000","last_clean":"2024-09-16T16:51:53.265973+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:51:53.265973+0000","last_undegraded":"2024-09-16T16:51:53.265973+0000","last_fullsized":"2024-09-16T16:51:53.265973+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'568","reported_seq":580,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.632424+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:51:52.632424+0000","last_peered":"2024-09-16T16:51:52.632424+0000","last_clean":"2024-09-16T16:51:52.632424+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:51:52.632424+0000","last_undegraded":"2024-09-16T16:51:52.632424+0000","last_fullsized":"2024-09-16T16:51:52.632424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'576","reported_seq":588,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:52.139724+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:51:52.139724+0000","last_peered":"2024-09-16T16:51:52.139724+0000","last_clean":"2024-09-16T16:51:52.139724+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:51:52.139724+0000","last_undegraded":"2024-09-16T16:51:52.139724+0000","last_fullsized":"2024-09-16T16:51:52.139724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'488","reported_seq":500,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:51:53.458295+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:51:53.458295+0000","last_peered":"2024-09-16T16:51:53.458295+0000","last_clean":"2024-09-16T16:51:53.458295+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:51:53.458295+0000","last_undegraded":"2024-09-16T16:51:53.458295+0000","last_fullsized":"2024-09-16T16:51:53.458295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":61300736,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7483,"num_write_kb":59864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823983616,"internally_reserved":0,"allocated":387510272,"data_stored":387510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7483,"ondisk_log_size":7483,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213823991808,"internally_reserved":0,"allocated":387502080,"data_stored":387502080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":85908,"kb_used_data":85908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52211820,"statfs":{"total":53552873472,"available":53464903680,"internally_reserved":0,"allocated":87969792,"data_stored":87969792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":106868,"kb_used_data":106868,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52190860,"statfs":{"total":53552873472,"available":53443440640,"internally_reserved":0,"allocated":109432832,"data_stored":109432832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76876,"kb_used_data":76876,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220852,"statfs":{"total":53552873472,"available":53474152448,"internally_reserved":0,"allocated":78721024,"data_stored":78721024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":104056,"kb_used_data":104056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193672,"statfs":{"total":53552873472,"available":53446320128,"internally_reserved":0,"allocated":106553344,"data_stored":106553344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53442023424,"internally_reserved":0,"allocated":110850048,"data_stored":110850048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53444812800,"internally_reserved":0,"allocated":108060672,"data_stored":108060672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53472956416,"internally_reserved":0,"allocated":79917056,"data_stored":79917056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53442015232,"internally_reserved":0,"allocated":110858240,"data_stored":110858240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53464199168,"internally_reserved":0,"allocated":88674304,"data_stored":88674304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:22.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:23.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:23.043+0000 7ff118b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:23.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:23.053+0000 7ff118b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:25.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:25.416+0000 7fb4fe391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:25.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:25.428+0000 7fb4fe391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:26.936 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1193 objects 2024-09-16T16:52:26.936 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :11.5511 2024-09-16T16:52:27.652 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:27.652 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:27.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:27.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:27.763+0000 7f874bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:27.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:27.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:27.771+0000 7f874bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:27.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:27.878+0000 7f0434eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:27.885+0000 7f0434eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:27.987 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-16T16:52:27.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-16T16:52:27.993 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:52:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:52:28.007 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-16T16:52:26.428528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16097867,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10579,"num_write_kb":77437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10553,"ondisk_log_size":10553,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":146100,"kb_used_data":146100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209044812,"statfs":{"total":214211493888,"available":214061887488,"internally_reserved":0,"allocated":149606400,"data_stored":149606400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-45793256,"num_objects":-698,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3015,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002318"},"pg_stats":[{"pgid":"5.f","version":"40'636","reported_seq":648,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.084374+0000","last_change":"2024-09-16T16:50:43.544796+0000","last_active":"2024-09-16T16:52:24.084374+0000","last_peered":"2024-09-16T16:52:24.084374+0000","last_clean":"2024-09-16T16:52:24.084374+0000","last_became_active":"2024-09-16T16:50:43.538590+0000","last_became_peered":"2024-09-16T16:50:43.538590+0000","last_unstale":"2024-09-16T16:52:24.084374+0000","last_undegraded":"2024-09-16T16:52:24.084374+0000","last_fullsized":"2024-09-16T16:52:24.084374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":636,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"40'577","reported_seq":589,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.115891+0000","last_change":"2024-09-16T16:50:43.427515+0000","last_active":"2024-09-16T16:52:24.115891+0000","last_peered":"2024-09-16T16:52:24.115891+0000","last_clean":"2024-09-16T16:52:24.115891+0000","last_became_active":"2024-09-16T16:50:43.418664+0000","last_became_peered":"2024-09-16T16:50:43.418664+0000","last_unstale":"2024-09-16T16:52:24.115891+0000","last_undegraded":"2024-09-16T16:52:24.115891+0000","last_fullsized":"2024-09-16T16:52:24.115891+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":577,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"40'691","reported_seq":704,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.009746+0000","last_change":"2024-09-16T16:50:43.437296+0000","last_active":"2024-09-16T16:52:24.009746+0000","last_peered":"2024-09-16T16:52:24.009746+0000","last_clean":"2024-09-16T16:52:24.009746+0000","last_became_active":"2024-09-16T16:50:43.426366+0000","last_became_peered":"2024-09-16T16:50:43.426366+0000","last_unstale":"2024-09-16T16:52:24.009746+0000","last_undegraded":"2024-09-16T16:52:24.009746+0000","last_fullsized":"2024-09-16T16:52:24.009746+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786456,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":691,"num_write_kb":4993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'704","reported_seq":716,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:23.200622+0000","last_change":"2024-09-16T16:50:43.366925+0000","last_active":"2024-09-16T16:52:23.200622+0000","last_peered":"2024-09-16T16:52:23.200622+0000","last_clean":"2024-09-16T16:52:23.200622+0000","last_became_active":"2024-09-16T16:50:43.348112+0000","last_became_peered":"2024-09-16T16:50:43.348112+0000","last_unstale":"2024-09-16T16:52:23.200622+0000","last_undegraded":"2024-09-16T16:52:23.200622+0000","last_fullsized":"2024-09-16T16:52:23.200622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"40'688","reported_seq":700,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.234301+0000","last_change":"2024-09-16T16:50:43.469305+0000","last_active":"2024-09-16T16:52:24.234301+0000","last_peered":"2024-09-16T16:52:24.234301+0000","last_clean":"2024-09-16T16:52:24.234301+0000","last_became_active":"2024-09-16T16:50:43.453858+0000","last_became_peered":"2024-09-16T16:50:43.453858+0000","last_unstale":"2024-09-16T16:52:24.234301+0000","last_undegraded":"2024-09-16T16:52:24.234301+0000","last_fullsized":"2024-09-16T16:52:24.234301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"40'642","reported_seq":654,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:23.572578+0000","last_change":"2024-09-16T16:50:43.432379+0000","last_active":"2024-09-16T16:52:23.572578+0000","last_peered":"2024-09-16T16:52:23.572578+0000","last_clean":"2024-09-16T16:52:23.572578+0000","last_became_active":"2024-09-16T16:50:43.417017+0000","last_became_peered":"2024-09-16T16:50:43.417017+0000","last_unstale":"2024-09-16T16:52:23.572578+0000","last_undegraded":"2024-09-16T16:52:23.572578+0000","last_fullsized":"2024-09-16T16:52:23.572578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"40'599","reported_seq":611,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.301784+0000","last_change":"2024-09-16T16:50:43.387542+0000","last_active":"2024-09-16T16:52:24.301784+0000","last_peered":"2024-09-16T16:52:24.301784+0000","last_clean":"2024-09-16T16:52:24.301784+0000","last_became_active":"2024-09-16T16:50:43.364518+0000","last_became_peered":"2024-09-16T16:50:43.364518+0000","last_unstale":"2024-09-16T16:52:24.301784+0000","last_undegraded":"2024-09-16T16:52:24.301784+0000","last_fullsized":"2024-09-16T16:52:24.301784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"40'708","reported_seq":720,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:23.381364+0000","last_change":"2024-09-16T16:50:43.464027+0000","last_active":"2024-09-16T16:52:23.381364+0000","last_peered":"2024-09-16T16:52:23.381364+0000","last_clean":"2024-09-16T16:52:23.381364+0000","last_became_active":"2024-09-16T16:50:43.449441+0000","last_became_peered":"2024-09-16T16:50:43.449441+0000","last_unstale":"2024-09-16T16:52:23.381364+0000","last_undegraded":"2024-09-16T16:52:23.381364+0000","last_fullsized":"2024-09-16T16:52:23.381364+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"40'661","reported_seq":673,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.336659+0000","last_change":"2024-09-16T16:50:43.503605+0000","last_active":"2024-09-16T16:52:24.336659+0000","last_peered":"2024-09-16T16:52:24.336659+0000","last_clean":"2024-09-16T16:52:24.336659+0000","last_became_active":"2024-09-16T16:50:43.497242+0000","last_became_peered":"2024-09-16T16:50:43.497242+0000","last_unstale":"2024-09-16T16:52:24.336659+0000","last_undegraded":"2024-09-16T16:52:24.336659+0000","last_fullsized":"2024-09-16T16:52:24.336659+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'683","reported_seq":695,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.261164+0000","last_change":"2024-09-16T16:50:43.417938+0000","last_active":"2024-09-16T16:52:24.261164+0000","last_peered":"2024-09-16T16:52:24.261164+0000","last_clean":"2024-09-16T16:52:24.261164+0000","last_became_active":"2024-09-16T16:50:43.405744+0000","last_became_peered":"2024-09-16T16:50:43.405744+0000","last_unstale":"2024-09-16T16:52:24.261164+0000","last_undegraded":"2024-09-16T16:52:24.261164+0000","last_fullsized":"2024-09-16T16:52:24.261164+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'596","reported_seq":608,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.077503+0000","last_change":"2024-09-16T16:50:43.567344+0000","last_active":"2024-09-16T16:52:24.077503+0000","last_peered":"2024-09-16T16:52:24.077503+0000","last_clean":"2024-09-16T16:52:24.077503+0000","last_became_active":"2024-09-16T16:50:43.561222+0000","last_became_peered":"2024-09-16T16:50:43.561222+0000","last_unstale":"2024-09-16T16:52:24.077503+0000","last_undegraded":"2024-09-16T16:52:24.077503+0000","last_fullsized":"2024-09-16T16:52:24.077503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":596,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"40'492","reported_seq":504,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:23.859706+0000","last_change":"2024-09-16T16:50:43.395575+0000","last_active":"2024-09-16T16:52:23.859706+0000","last_peered":"2024-09-16T16:52:23.859706+0000","last_clean":"2024-09-16T16:52:23.859706+0000","last_became_active":"2024-09-16T16:50:43.361304+0000","last_became_peered":"2024-09-16T16:50:43.361304+0000","last_unstale":"2024-09-16T16:52:23.859706+0000","last_undegraded":"2024-09-16T16:52:23.859706+0000","last_fullsized":"2024-09-16T16:52:23.859706+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"40'585","reported_seq":597,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.344434+0000","last_change":"2024-09-16T16:50:43.382738+0000","last_active":"2024-09-16T16:52:24.344434+0000","last_peered":"2024-09-16T16:52:24.344434+0000","last_clean":"2024-09-16T16:52:24.344434+0000","last_became_active":"2024-09-16T16:50:43.354308+0000","last_became_peered":"2024-09-16T16:50:43.354308+0000","last_unstale":"2024-09-16T16:52:24.344434+0000","last_undegraded":"2024-09-16T16:52:24.344434+0000","last_fullsized":"2024-09-16T16:52:24.344434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"40'753","reported_seq":765,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.221376+0000","last_change":"2024-09-16T16:50:43.402430+0000","last_active":"2024-09-16T16:52:24.221376+0000","last_peered":"2024-09-16T16:52:24.221376+0000","last_clean":"2024-09-16T16:52:24.221376+0000","last_became_active":"2024-09-16T16:50:43.394941+0000","last_became_peered":"2024-09-16T16:50:43.394941+0000","last_unstale":"2024-09-16T16:52:24.221376+0000","last_undegraded":"2024-09-16T16:52:24.221376+0000","last_fullsized":"2024-09-16T16:52:24.221376+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'744","reported_seq":756,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:23.638457+0000","last_change":"2024-09-16T16:50:43.463684+0000","last_active":"2024-09-16T16:52:23.638457+0000","last_peered":"2024-09-16T16:52:23.638457+0000","last_clean":"2024-09-16T16:52:23.638457+0000","last_became_active":"2024-09-16T16:50:43.455159+0000","last_became_peered":"2024-09-16T16:50:43.455159+0000","last_unstale":"2024-09-16T16:52:23.638457+0000","last_undegraded":"2024-09-16T16:52:23.638457+0000","last_fullsized":"2024-09-16T16:52:23.638457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'739","reported_seq":751,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:52:24.008616+0000","last_change":"2024-09-16T16:50:43.502149+0000","last_active":"2024-09-16T16:52:24.008616+0000","last_peered":"2024-09-16T16:52:24.008616+0000","last_clean":"2024-09-16T16:52:24.008616+0000","last_became_active":"2024-09-16T16:50:43.493599+0000","last_became_peered":"2024-09-16T16:50:43.493599+0000","last_unstale":"2024-09-16T16:52:24.008616+0000","last_undegraded":"2024-09-16T16:52:24.008616+0000","last_fullsized":"2024-09-16T16:52:24.008616+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:50:42.225444+0000","last_clean_scrub_stamp":"2024-09-16T16:50:42.225444+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482752,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":5416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":15507480,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10498,"num_write_kb":76329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214092746752,"internally_reserved":0,"allocated":118747136,"data_stored":118747136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10498,"ondisk_log_size":10498,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214092746752,"internally_reserved":0,"allocated":118747136,"data_stored":118747136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32984,"kb_used_data":32984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52264744,"statfs":{"total":53552873472,"available":53519097856,"internally_reserved":0,"allocated":33775616,"data_stored":33775616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42096,"kb_used_data":42096,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52255632,"statfs":{"total":53552873472,"available":53509767168,"internally_reserved":0,"allocated":43106304,"data_stored":43106304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":31256,"kb_used_data":31256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52266472,"statfs":{"total":53552873472,"available":53520867328,"internally_reserved":0,"allocated":32006144,"data_stored":32006144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":39764,"kb_used_data":39764,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52257964,"statfs":{"total":53552873472,"available":53512155136,"internally_reserved":0,"allocated":40718336,"data_stored":40718336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53521063936,"internally_reserved":0,"allocated":31809536,"data_stored":31809536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53527814144,"internally_reserved":0,"allocated":25059328,"data_stored":25059328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53516972032,"internally_reserved":0,"allocated":35901440,"data_stored":35901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":53552873472,"available":53521063936,"internally_reserved":0,"allocated":31809536,"data_stored":31809536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":53552873472,"available":53527814144,"internally_reserved":0,"allocated":25059328,"data_stored":25059328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":53552873472,"available":53516972032,"internally_reserved":0,"allocated":35901440,"data_stored":35901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:28.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:28.098+0000 7f8853b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:28.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:28.111+0000 7f8853b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:28.367 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_2' removed 2024-09-16T16:52:28.383 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:52:28.384 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:52:28.385 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-16T16:52:28.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-16T16:52:28.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:28.569+0000 7f819c088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:28.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:28.591+0000 7f819c088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:29.376 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_3' created 2024-09-16T16:52:29.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-16T16:52:29.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:29.535+0000 7fd633f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:29.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:29.549+0000 7fd633f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:30.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:30.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:30.112+0000 7f63d0c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:30.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:30.118+0000 7f63d0c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:30.379 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-16T16:52:31.403 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-16T16:52:31.406 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:52:31.406 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:52:31.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:52:31.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:52:31.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_42331 2024-09-16T16:52:31.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:52:31.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:52:32.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:32.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:32.363+0000 7f1e3e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:32.370+0000 7f1e3e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:32.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 124 108 0.843708 0.84375 0.155885 0.125689 2024-09-16T16:52:33.010 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:33.010 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:33.010 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:52:33.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:52:33.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.133+0000 7f1e6e4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.145+0000 7f1e6e4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:33.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:33.211 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:33.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:52:33.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.362+0000 7fca31991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.375+0000 7fca31991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:33.467 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:33.468 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:33.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:52:33.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 256 240 0.937443 1.03125 0.0814958 0.126094 2024-09-16T16:52:33.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.590+0000 7f46e3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.603+0000 7f46e3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:33.671 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:33.672 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:33.675 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:33.676 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:33.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:52:33.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.848+0000 7f54ce0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:33.859+0000 7f54ce0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:33.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:33.881 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:34.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 347 331 0.861919 0.710938 0.319043 0.136377 2024-09-16T16:52:34.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:34.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:34.754+0000 7f6ed4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:34.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:34.763+0000 7f6ed4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:35.478 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 15 440 425 0.830017 0.734375 0.177042 0.147218 2024-09-16T16:52:36.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 555 539 0.842123 0.890625 0.0275544 0.144986 2024-09-16T16:52:37.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:37.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:37.178+0000 7fcf80591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:37.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:37.185+0000 7fcf80591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:37.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 657 641 0.83457 0.796875 0.193809 0.147432 2024-09-16T16:52:38.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 778 762 0.850379 0.945312 0.177587 0.14562 2024-09-16T16:52:38.882 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:38.882 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:38.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:39.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:39.017+0000 7f6acb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:39.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:39.028+0000 7f6acb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:39.314 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:52:39.314 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:52:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2024-09-16T16:52:38.431001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":146100,"kb_used_data":146100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209044812,"statfs":{"total":214211493888,"available":214061887488,"internally_reserved":0,"allocated":149606400,"data_stored":149606400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.050865"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214092746752,"internally_reserved":0,"allocated":118747136,"data_stored":118747136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32984,"kb_used_data":32984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52264744,"statfs":{"total":53552873472,"available":53519097856,"internally_reserved":0,"allocated":33775616,"data_stored":33775616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42096,"kb_used_data":42096,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52255632,"statfs":{"total":53552873472,"available":53509767168,"internally_reserved":0,"allocated":43106304,"data_stored":43106304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":31256,"kb_used_data":31256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52266472,"statfs":{"total":53552873472,"available":53520867328,"internally_reserved":0,"allocated":32006144,"data_stored":32006144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":39764,"kb_used_data":39764,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52257964,"statfs":{"total":53552873472,"available":53512155136,"internally_reserved":0,"allocated":40718336,"data_stored":40718336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53521063936,"internally_reserved":0,"allocated":31809536,"data_stored":31809536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53527814144,"internally_reserved":0,"allocated":25059328,"data_stored":25059328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53516972032,"internally_reserved":0,"allocated":35901440,"data_stored":35901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:39.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 888 872 0.851493 0.859375 0.100908 0.145519 2024-09-16T16:52:39.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:39.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:39.632+0000 7f07ab0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:39.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:39.639+0000 7f07ab0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:40.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 1001 985 0.854965 0.882812 0.0506595 0.143738 2024-09-16T16:52:41.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 1110 1094 0.854617 0.851562 0.134287 0.145076 2024-09-16T16:52:41.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:41.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:41.937+0000 7f159b66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:41.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:41.945+0000 7f159b66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:42.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1207 1191 0.845809 0.757812 0.0736889 0.146192 2024-09-16T16:52:43.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1316 1300 0.846281 0.851562 0.188631 0.14684 2024-09-16T16:52:44.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:44.339 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:44.339 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:44.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:52:44.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:44.392+0000 7f273debd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:44.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:44.400+0000 7f273debd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:44.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:44.469+0000 7fe36daa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:44.479 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1393 1377 0.827453 0.601562 0.743463 0.146781 2024-09-16T16:52:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:44.479+0000 7fe36daa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:44.841 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:52:44.841 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:52:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-09-16T16:52:44.432086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":146100,"kb_used_data":146100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209044812,"statfs":{"total":214211493888,"available":214061887488,"internally_reserved":0,"allocated":149606400,"data_stored":149606400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002285"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.253331+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:50:44.253331+0000","last_peered":"2024-09-16T16:50:44.253331+0000","last_clean":"2024-09-16T16:50:44.253331+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:50:44.253331+0000","last_undegraded":"2024-09-16T16:50:44.253331+0000","last_fullsized":"2024-09-16T16:50:44.253331+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":86,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.258803+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:50:44.258803+0000","last_peered":"2024-09-16T16:50:44.258803+0000","last_clean":"2024-09-16T16:50:44.258803+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:50:44.258803+0000","last_undegraded":"2024-09-16T16:50:44.258803+0000","last_fullsized":"2024-09-16T16:50:44.258803+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.264576+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:50:44.264576+0000","last_peered":"2024-09-16T16:50:44.264576+0000","last_clean":"2024-09-16T16:50:44.264576+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:50:44.264576+0000","last_undegraded":"2024-09-16T16:50:44.264576+0000","last_fullsized":"2024-09-16T16:50:44.264576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254208+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:50:44.254208+0000","last_peered":"2024-09-16T16:50:44.254208+0000","last_clean":"2024-09-16T16:50:44.254208+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:50:44.254208+0000","last_undegraded":"2024-09-16T16:50:44.254208+0000","last_fullsized":"2024-09-16T16:50:44.254208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":87,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.254435+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:50:44.254435+0000","last_peered":"2024-09-16T16:50:44.254435+0000","last_clean":"2024-09-16T16:50:44.254435+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:50:44.254435+0000","last_undegraded":"2024-09-16T16:50:44.254435+0000","last_fullsized":"2024-09-16T16:50:44.254435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262466+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:50:44.262466+0000","last_peered":"2024-09-16T16:50:44.262466+0000","last_clean":"2024-09-16T16:50:44.262466+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:50:44.262466+0000","last_undegraded":"2024-09-16T16:50:44.262466+0000","last_fullsized":"2024-09-16T16:50:44.262466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.260250+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:50:44.260250+0000","last_peered":"2024-09-16T16:50:44.260250+0000","last_clean":"2024-09-16T16:50:44.260250+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:50:44.260250+0000","last_undegraded":"2024-09-16T16:50:44.260250+0000","last_fullsized":"2024-09-16T16:50:44.260250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.262982+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:50:44.262982+0000","last_peered":"2024-09-16T16:50:44.262982+0000","last_clean":"2024-09-16T16:50:44.262982+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:50:44.262982+0000","last_undegraded":"2024-09-16T16:50:44.262982+0000","last_fullsized":"2024-09-16T16:50:44.262982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:52:29.372440+0000","last_change":"2024-09-16T16:52:29.372440+0000","last_active":"2024-09-16T16:52:29.372440+0000","last_peered":"2024-09-16T16:52:29.372440+0000","last_clean":"2024-09-16T16:52:29.372440+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:52:29.372440+0000","last_undegraded":"2024-09-16T16:52:29.372440+0000","last_fullsized":"2024-09-16T16:52:29.372440+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T16:50:44.259408+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:50:44.259408+0000","last_peered":"2024-09-16T16:50:44.259408+0000","last_clean":"2024-09-16T16:50:44.259408+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:50:44.259408+0000","last_undegraded":"2024-09-16T16:50:44.259408+0000","last_fullsized":"2024-09-16T16:50:44.259408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214092746752,"internally_reserved":0,"allocated":118747136,"data_stored":118747136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32984,"kb_used_data":32984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52264744,"statfs":{"total":53552873472,"available":53519097856,"internally_reserved":0,"allocated":33775616,"data_stored":33775616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42096,"kb_used_data":42096,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52255632,"statfs":{"total":53552873472,"available":53509767168,"internally_reserved":0,"allocated":43106304,"data_stored":43106304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":31256,"kb_used_data":31256,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52266472,"statfs":{"total":53552873472,"available":53520867328,"internally_reserved":0,"allocated":32006144,"data_stored":32006144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":39764,"kb_used_data":39764,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52257964,"statfs":{"total":53552873472,"available":53512155136,"internally_reserved":0,"allocated":40718336,"data_stored":40718336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53521063936,"internally_reserved":0,"allocated":31809536,"data_stored":31809536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53527814144,"internally_reserved":0,"allocated":25059328,"data_stored":25059328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53516972032,"internally_reserved":0,"allocated":35901440,"data_stored":35901440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53526896640,"internally_reserved":0,"allocated":25976832,"data_stored":25976832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:52:45.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1517 1501 0.83754 0.96875 0.0875923 0.148679 2024-09-16T16:52:46.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1630 1614 0.840553 0.882812 0.224125 0.147926 2024-09-16T16:52:46.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:46.711+0000 7f971af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:46.720+0000 7f971af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:47.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1729 1713 0.836354 0.773438 0.0558331 0.148724 2024-09-16T16:52:48.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1824 1808 0.83081 0.742188 0.218975 0.149314 2024-09-16T16:52:48.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:49.108+0000 7fd3fa0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:49.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:49.118+0000 7fd3fa0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:49.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 1934 1918 0.832393 0.859375 0.0956438 0.149565 2024-09-16T16:52:49.860 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:49.861 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:49.861 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:52:49.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:52:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:49.993+0000 7f7093b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:50.006+0000 7f7093b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:50.039 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:50.040 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:50.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:52:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:50.172+0000 7f87e2d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:50.191+0000 7f87e2d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.302 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:50.302 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:50.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:50.308 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:50.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:52:50.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:50.457+0000 7fefebab4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:50.469+0000 7fefebab4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 2041 2025 0.832575 0.835938 0.127441 0.149517 2024-09-16T16:52:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:50.547 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:50.548 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:50.548 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:50.548 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:50.548 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:50.548 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:50.548 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:50.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:50.553 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:50.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:52:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:50.732+0000 7f036b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:50.751+0000 7f036b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:50.787 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:50.788 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:50.793 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:50.793 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:51.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:51.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:52:51.480560+0000 min lat: 0.0213974 max lat: 0.866328 avg lat: 0.14806 2024-09-16T16:52:51.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:52:51.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2172 2156 0.842113 1.02344 0.09294 0.14806 2024-09-16T16:52:51.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:51.526+0000 7f6056f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:51.534+0000 7f6056f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:52.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 16 2284 2268 0.843675 0.875 0.139597 0.147527 2024-09-16T16:52:53.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2370 2354 0.835862 0.671875 0.302126 0.148588 2024-09-16T16:52:53.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:54.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:54.109+0000 7f6a3bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:54.121+0000 7f6a3bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:54.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2483 2467 0.8379 0.882812 0.210398 0.148357 2024-09-16T16:52:55.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2574 2558 0.832606 0.710938 0.0467597 0.148902 2024-09-16T16:52:55.793 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:52:55.794 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:52:55.794 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:52:55.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:52:55.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:55.915+0000 7fb9f32a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:55.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:55.928+0000 7fb9f32a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:56.011 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:56.015 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:56.015 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:56.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:52:56.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.134+0000 7f1fa4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.148+0000 7f1fa4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.210 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:56.210 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:56.210 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:56.211 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:56.214 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:56.214 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:56.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:52:56.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.335+0000 7f6065d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.349+0000 7f6065d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:52:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:56.435 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:56.436 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:56.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:52:56.480 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2689 2673 0.835236 0.898438 0.114409 0.149125 2024-09-16T16:52:56.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.561+0000 7f6ed2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.570+0000 7f6ed2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.638+0000 7f927d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:56.655+0000 7f927d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:52:56.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:52:56.680 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:52:56.683 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:52:56.684 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:52:57.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 2811 2795 0.839767 0.953125 0.125727 0.14833 2024-09-16T16:52:58.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 2933 2917 0.843962 0.953125 0.147744 0.147768 2024-09-16T16:52:58.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:52:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:59.039+0000 7f59f7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:59.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:52:59.048+0000 7f59f7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:52:59.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 3025 3009 0.839487 0.71875 0.199167 0.148311 2024-09-16T16:53:00.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 3156 3140 0.845827 1.02344 0.0854452 0.147447 2024-09-16T16:53:01.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:01.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 3279 3263 0.849661 0.960938 0.0948088 0.146697 2024-09-16T16:53:01.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:01.512+0000 7f58bb874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:01.523+0000 7f58bb874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:01.684 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:01.684 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:01.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:01.858+0000 7f5b4c308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:01.869+0000 7f5b4c308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:02.076 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:53:02.077 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:53:02.091 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-16T16:53:00.435149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20881971,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2558,"num_write_kb":20924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2532,"ondisk_log_size":2532,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":123984,"kb_used_data":123984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209066928,"statfs":{"total":214211493888,"available":214084534272,"internally_reserved":0,"allocated":126959616,"data_stored":126959616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20291584,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2477,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002299"},"pg_stats":[{"pgid":"6.f","version":"44'117","reported_seq":129,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:54.371339+0000","last_change":"2024-09-16T16:52:30.561960+0000","last_active":"2024-09-16T16:52:54.371339+0000","last_peered":"2024-09-16T16:52:54.371339+0000","last_clean":"2024-09-16T16:52:54.371339+0000","last_became_active":"2024-09-16T16:52:30.550642+0000","last_became_peered":"2024-09-16T16:52:30.550642+0000","last_unstale":"2024-09-16T16:52:54.371339+0000","last_undegraded":"2024-09-16T16:52:54.371339+0000","last_fullsized":"2024-09-16T16:52:54.371339+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":958464,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"44'104","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:52.160664+0000","last_change":"2024-09-16T16:52:30.539031+0000","last_active":"2024-09-16T16:52:52.160664+0000","last_peered":"2024-09-16T16:52:52.160664+0000","last_clean":"2024-09-16T16:52:52.160664+0000","last_became_active":"2024-09-16T16:52:30.520980+0000","last_became_peered":"2024-09-16T16:52:30.520980+0000","last_unstale":"2024-09-16T16:52:52.160664+0000","last_undegraded":"2024-09-16T16:52:52.160664+0000","last_fullsized":"2024-09-16T16:52:52.160664+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"44'184","reported_seq":196,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:53.932731+0000","last_change":"2024-09-16T16:52:30.569209+0000","last_active":"2024-09-16T16:52:53.932731+0000","last_peered":"2024-09-16T16:52:53.932731+0000","last_clean":"2024-09-16T16:52:53.932731+0000","last_became_active":"2024-09-16T16:52:30.553224+0000","last_became_peered":"2024-09-16T16:52:30.553224+0000","last_unstale":"2024-09-16T16:52:53.932731+0000","last_undegraded":"2024-09-16T16:52:53.932731+0000","last_fullsized":"2024-09-16T16:52:53.932731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"44'160","reported_seq":172,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:54.028035+0000","last_change":"2024-09-16T16:52:30.581450+0000","last_active":"2024-09-16T16:52:54.028035+0000","last_peered":"2024-09-16T16:52:54.028035+0000","last_clean":"2024-09-16T16:52:54.028035+0000","last_became_active":"2024-09-16T16:52:30.573533+0000","last_became_peered":"2024-09-16T16:52:30.573533+0000","last_unstale":"2024-09-16T16:52:54.028035+0000","last_undegraded":"2024-09-16T16:52:54.028035+0000","last_fullsized":"2024-09-16T16:52:54.028035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'168","reported_seq":180,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:53.441328+0000","last_change":"2024-09-16T16:52:30.552895+0000","last_active":"2024-09-16T16:52:53.441328+0000","last_peered":"2024-09-16T16:52:53.441328+0000","last_clean":"2024-09-16T16:52:53.441328+0000","last_became_active":"2024-09-16T16:52:30.529127+0000","last_became_peered":"2024-09-16T16:52:30.529127+0000","last_unstale":"2024-09-16T16:52:53.441328+0000","last_undegraded":"2024-09-16T16:52:53.441328+0000","last_fullsized":"2024-09-16T16:52:53.441328+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"44'144","reported_seq":156,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:51.073032+0000","last_change":"2024-09-16T16:52:30.536577+0000","last_active":"2024-09-16T16:52:51.073032+0000","last_peered":"2024-09-16T16:52:51.073032+0000","last_clean":"2024-09-16T16:52:51.073032+0000","last_became_active":"2024-09-16T16:52:30.525172+0000","last_became_peered":"2024-09-16T16:52:30.525172+0000","last_unstale":"2024-09-16T16:52:51.073032+0000","last_undegraded":"2024-09-16T16:52:51.073032+0000","last_fullsized":"2024-09-16T16:52:51.073032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"44'136","reported_seq":148,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:53.039341+0000","last_change":"2024-09-16T16:52:30.522508+0000","last_active":"2024-09-16T16:52:53.039341+0000","last_peered":"2024-09-16T16:52:53.039341+0000","last_clean":"2024-09-16T16:52:53.039341+0000","last_became_active":"2024-09-16T16:52:30.510458+0000","last_became_peered":"2024-09-16T16:52:30.510458+0000","last_unstale":"2024-09-16T16:52:53.039341+0000","last_undegraded":"2024-09-16T16:52:53.039341+0000","last_fullsized":"2024-09-16T16:52:53.039341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"44'160","reported_seq":172,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:53.819442+0000","last_change":"2024-09-16T16:52:30.595812+0000","last_active":"2024-09-16T16:52:53.819442+0000","last_peered":"2024-09-16T16:52:53.819442+0000","last_clean":"2024-09-16T16:52:53.819442+0000","last_became_active":"2024-09-16T16:52:30.534721+0000","last_became_peered":"2024-09-16T16:52:30.534721+0000","last_unstale":"2024-09-16T16:52:53.819442+0000","last_undegraded":"2024-09-16T16:52:53.819442+0000","last_fullsized":"2024-09-16T16:52:53.819442+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'176","reported_seq":188,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:54.249439+0000","last_change":"2024-09-16T16:52:30.520663+0000","last_active":"2024-09-16T16:52:54.249439+0000","last_peered":"2024-09-16T16:52:54.249439+0000","last_clean":"2024-09-16T16:52:54.249439+0000","last_became_active":"2024-09-16T16:52:30.508854+0000","last_became_peered":"2024-09-16T16:52:30.508854+0000","last_unstale":"2024-09-16T16:52:54.249439+0000","last_undegraded":"2024-09-16T16:52:54.249439+0000","last_fullsized":"2024-09-16T16:52:54.249439+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":172,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.407979+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:52:31.407979+0000","last_peered":"2024-09-16T16:52:31.407979+0000","last_clean":"2024-09-16T16:52:31.407979+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:52:31.407979+0000","last_undegraded":"2024-09-16T16:52:31.407979+0000","last_fullsized":"2024-09-16T16:52:31.407979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":98,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413184+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:52:31.413184+0000","last_peered":"2024-09-16T16:52:31.413184+0000","last_clean":"2024-09-16T16:52:31.413184+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:52:31.413184+0000","last_undegraded":"2024-09-16T16:52:31.413184+0000","last_fullsized":"2024-09-16T16:52:31.413184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"44'144","reported_seq":156,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:54.193380+0000","last_change":"2024-09-16T16:52:30.625723+0000","last_active":"2024-09-16T16:52:54.193380+0000","last_peered":"2024-09-16T16:52:54.193380+0000","last_clean":"2024-09-16T16:52:54.193380+0000","last_became_active":"2024-09-16T16:52:30.619486+0000","last_became_peered":"2024-09-16T16:52:30.619486+0000","last_unstale":"2024-09-16T16:52:54.193380+0000","last_undegraded":"2024-09-16T16:52:54.193380+0000","last_fullsized":"2024-09-16T16:52:54.193380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413103+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:52:31.413103+0000","last_peered":"2024-09-16T16:52:31.413103+0000","last_clean":"2024-09-16T16:52:31.413103+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:52:31.413103+0000","last_undegraded":"2024-09-16T16:52:31.413103+0000","last_fullsized":"2024-09-16T16:52:31.413103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"44'176","reported_seq":188,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:53.751539+0000","last_change":"2024-09-16T16:52:30.560847+0000","last_active":"2024-09-16T16:52:53.751539+0000","last_peered":"2024-09-16T16:52:53.751539+0000","last_clean":"2024-09-16T16:52:53.751539+0000","last_became_active":"2024-09-16T16:52:30.523734+0000","last_became_peered":"2024-09-16T16:52:30.523734+0000","last_unstale":"2024-09-16T16:52:53.751539+0000","last_undegraded":"2024-09-16T16:52:53.751539+0000","last_fullsized":"2024-09-16T16:52:53.751539+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.405471+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:52:31.405471+0000","last_peered":"2024-09-16T16:52:31.405471+0000","last_clean":"2024-09-16T16:52:31.405471+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:52:31.405471+0000","last_undegraded":"2024-09-16T16:52:31.405471+0000","last_fullsized":"2024-09-16T16:52:31.405471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"44'168","reported_seq":180,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:51.939714+0000","last_change":"2024-09-16T16:52:30.486241+0000","last_active":"2024-09-16T16:52:51.939714+0000","last_peered":"2024-09-16T16:52:51.939714+0000","last_clean":"2024-09-16T16:52:51.939714+0000","last_became_active":"2024-09-16T16:52:30.478327+0000","last_became_peered":"2024-09-16T16:52:30.478327+0000","last_unstale":"2024-09-16T16:52:51.939714+0000","last_undegraded":"2024-09-16T16:52:51.939714+0000","last_fullsized":"2024-09-16T16:52:51.939714+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":99,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.407006+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:52:31.407006+0000","last_peered":"2024-09-16T16:52:31.407006+0000","last_clean":"2024-09-16T16:52:31.407006+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:52:31.407006+0000","last_undegraded":"2024-09-16T16:52:31.407006+0000","last_fullsized":"2024-09-16T16:52:31.407006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"44'144","reported_seq":156,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:51.871792+0000","last_change":"2024-09-16T16:52:30.531346+0000","last_active":"2024-09-16T16:52:51.871792+0000","last_peered":"2024-09-16T16:52:51.871792+0000","last_clean":"2024-09-16T16:52:51.871792+0000","last_became_active":"2024-09-16T16:52:30.499337+0000","last_became_peered":"2024-09-16T16:52:30.499337+0000","last_unstale":"2024-09-16T16:52:51.871792+0000","last_undegraded":"2024-09-16T16:52:51.871792+0000","last_fullsized":"2024-09-16T16:52:51.871792+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413669+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:52:31.413669+0000","last_peered":"2024-09-16T16:52:31.413669+0000","last_clean":"2024-09-16T16:52:31.413669+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:52:31.413669+0000","last_undegraded":"2024-09-16T16:52:31.413669+0000","last_fullsized":"2024-09-16T16:52:31.413669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"44'104","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:52.534107+0000","last_change":"2024-09-16T16:52:30.582884+0000","last_active":"2024-09-16T16:52:52.534107+0000","last_peered":"2024-09-16T16:52:52.534107+0000","last_clean":"2024-09-16T16:52:52.534107+0000","last_became_active":"2024-09-16T16:52:30.575087+0000","last_became_peered":"2024-09-16T16:52:30.575087+0000","last_unstale":"2024-09-16T16:52:52.534107+0000","last_undegraded":"2024-09-16T16:52:52.534107+0000","last_fullsized":"2024-09-16T16:52:52.534107+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.412215+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:52:31.412215+0000","last_peered":"2024-09-16T16:52:31.412215+0000","last_clean":"2024-09-16T16:52:31.412215+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:52:31.412215+0000","last_undegraded":"2024-09-16T16:52:31.412215+0000","last_fullsized":"2024-09-16T16:52:31.412215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"44'184","reported_seq":196,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:53.536823+0000","last_change":"2024-09-16T16:52:30.659248+0000","last_active":"2024-09-16T16:52:53.536823+0000","last_peered":"2024-09-16T16:52:53.536823+0000","last_clean":"2024-09-16T16:52:53.536823+0000","last_became_active":"2024-09-16T16:52:30.652888+0000","last_became_peered":"2024-09-16T16:52:30.652888+0000","last_unstale":"2024-09-16T16:52:53.536823+0000","last_undegraded":"2024-09-16T16:52:53.536823+0000","last_fullsized":"2024-09-16T16:52:53.536823+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.412703+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:52:31.412703+0000","last_peered":"2024-09-16T16:52:31.412703+0000","last_clean":"2024-09-16T16:52:31.412703+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:52:31.412703+0000","last_undegraded":"2024-09-16T16:52:31.412703+0000","last_fullsized":"2024-09-16T16:52:31.412703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"44'208","reported_seq":220,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:54.308406+0000","last_change":"2024-09-16T16:52:30.597509+0000","last_active":"2024-09-16T16:52:54.308406+0000","last_peered":"2024-09-16T16:52:54.308406+0000","last_clean":"2024-09-16T16:52:54.308406+0000","last_became_active":"2024-09-16T16:52:30.585924+0000","last_became_peered":"2024-09-16T16:52:30.585924+0000","last_unstale":"2024-09-16T16:52:54.308406+0000","last_undegraded":"2024-09-16T16:52:54.308406+0000","last_fullsized":"2024-09-16T16:52:54.308406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.416555+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:52:31.416555+0000","last_peered":"2024-09-16T16:52:31.416555+0000","last_clean":"2024-09-16T16:52:31.416555+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:52:31.416555+0000","last_undegraded":"2024-09-16T16:52:31.416555+0000","last_fullsized":"2024-09-16T16:52:31.416555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":20291584,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2477,"num_write_kb":19816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214079496192,"internally_reserved":0,"allocated":131997696,"data_stored":131997696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2477,"ondisk_log_size":2477,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214079512576,"internally_reserved":0,"allocated":131981312,"data_stored":131981312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53520482304,"internally_reserved":0,"allocated":32391168,"data_stored":32391168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":30200,"kb_used_data":30200,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52267528,"statfs":{"total":53552873472,"available":53521948672,"internally_reserved":0,"allocated":30924800,"data_stored":30924800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":27772,"kb_used_data":27772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52269956,"statfs":{"total":53552873472,"available":53524434944,"internally_reserved":0,"allocated":28438528,"data_stored":28438528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":32308,"kb_used_data":32308,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52265420,"statfs":{"total":53552873472,"available":53519790080,"internally_reserved":0,"allocated":33083392,"data_stored":33083392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":33704,"kb_used_data":33704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52264024,"statfs":{"total":53552873472,"available":53518360576,"internally_reserved":0,"allocated":34512896,"data_stored":34512896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53520482304,"internally_reserved":0,"allocated":32391168,"data_stored":32391168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53516918784,"internally_reserved":0,"allocated":35954688,"data_stored":35954688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53518303232,"internally_reserved":0,"allocated":34570240,"data_stored":34570240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53523808256,"internally_reserved":0,"allocated":29065216,"data_stored":29065216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53520482304,"internally_reserved":0,"allocated":32391168,"data_stored":32391168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53516902400,"internally_reserved":0,"allocated":35971072,"data_stored":35971072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53518303232,"internally_reserved":0,"allocated":34570240,"data_stored":34570240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53523808256,"internally_reserved":0,"allocated":29065216,"data_stored":29065216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53520482304,"internally_reserved":0,"allocated":32391168,"data_stored":32391168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:02.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3396 3380 0.851736 0.914062 0.0948565 0.14626 2024-09-16T16:53:03.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3519 3503 0.855146 0.960938 0.164525 0.145875 2024-09-16T16:53:03.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:03.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:03.876+0000 7f9e63d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:03.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:03.885+0000 7f9e63d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:04.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3636 3620 0.856929 0.914062 0.138475 0.145459 2024-09-16T16:53:05.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3751 3735 0.858147 0.898438 0.0805359 0.145392 2024-09-16T16:53:06.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:06.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:06.238+0000 7fa9b7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:06.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:06.245+0000 7fa9b7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:06.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 3829 3813 0.851037 0.609375 0.279854 0.146562 2024-09-16T16:53:07.093 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:07.093 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:07.093 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:07.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:07.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.249+0000 7faa6ff08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.270+0000 7faa6ff08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.392 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:07.392 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:07.393 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:07.397 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:07.398 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:07.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:07.481 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 3942 3926 0.851918 0.882812 0.0972269 0.146282 2024-09-16T16:53:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.564+0000 7f180e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.577+0000 7f180e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:07.597 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:07.598 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:07.601 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:07.602 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:07.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:07.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.722+0000 7f7f62191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.735+0000 7f7f62191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:07.761 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:07.762 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:07.762 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:07.762 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:07.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:07.765 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:07.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:07.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.891+0000 7f636bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:07.903+0000 7f636bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:07.921 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:07.922 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:07.925 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:07.925 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:08.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 4052 4036 0.852117 0.859375 0.152554 0.146443 2024-09-16T16:53:08.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:08.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:08.767+0000 7efbfa591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:08.775+0000 7efbfa591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:09.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 4139 4123 0.847578 0.679688 0.133152 0.147162 2024-09-16T16:53:10.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 4262 4246 0.850482 0.960938 0.122221 0.146719 2024-09-16T16:53:11.060 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:11.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:11.236+0000 7fb254b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:11.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:11.245+0000 7fb254b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:11.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:53:11.482524+0000 min lat: 0.0213974 max lat: 0.866328 avg lat: 0.146572 2024-09-16T16:53:11.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:53:11.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4372 4356 0.850702 0.859375 0.204845 0.146572 2024-09-16T16:53:12.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4480 4464 0.85053 0.84375 0.126085 0.146705 2024-09-16T16:53:12.926 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:12.926 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:12.926 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:12.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:13.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.063+0000 7f3a7bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.074+0000 7f3a7bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:13.101 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:13.104 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:13.104 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:13.105 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:13.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.219+0000 7fa03d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.230+0000 7fa03d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:13.250 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:13.254 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:13.254 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:13.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.393+0000 7f780349c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.408+0000 7f780349c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4591 4575 0.850924 0.867188 0.210032 0.146618 2024-09-16T16:53:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:13.496 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:13.497 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:13.500 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:13.500 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:13.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:13.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.632+0000 7fbd3f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.649+0000 7fbd3f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:13.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:13.683 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:13.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.706+0000 7f631ef48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:13.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:13.717+0000 7f631ef48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:14.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4686 4670 0.848394 0.742188 0.176378 0.1469 2024-09-16T16:53:15.482 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 16 4763 4747 0.842783 0.601562 0.0932437 0.147908 2024-09-16T16:53:15.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:16.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:16.124+0000 7f0cee711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:16.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:16.135+0000 7f0cee711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:16.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 4878 4862 0.844018 0.898438 0.157053 0.14782 2024-09-16T16:53:17.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 4971 4955 0.841463 0.726562 0.175596 0.148096 2024-09-16T16:53:18.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 16 5082 5066 0.842008 0.867188 0.127299 0.148198 2024-09-16T16:53:18.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:18.683 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:18.683 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:18.684 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:18.684 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:18.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:18.680+0000 7fa0fbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:18.691+0000 7fa0fbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:18.869+0000 7f8fcf097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:18.883+0000 7f8fcf097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:18.954 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:18.957 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:18.957 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:18.958 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:19.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:19.172+0000 7f971d84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:19.192+0000 7f971d84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:19.296 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:19.297 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:19.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:19.300 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:19.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:19.438+0000 7f8600cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:19.451+0000 7f8600cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 5190 5174 0.842043 0.84375 0.132154 0.148237 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:19.518 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:19.523 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:19.524 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:19.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:19.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:19.678+0000 7efeb2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:19.695+0000 7efeb172f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:19.714 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:19.714 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:19.714 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:19.714 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:19.714 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:19.714 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:19.715 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:19.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:19.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:19.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:19.715 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:19.715 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:19.718 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:19.718 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:20.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 5296 5280 0.841757 0.828125 0.198849 0.148271 2024-09-16T16:53:21.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:21.236+0000 7fa2faf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:21.244+0000 7fa2faf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:21.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 5407 5391 0.842264 0.867188 0.134309 0.148186 2024-09-16T16:53:22.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5508 5492 0.84122 0.789062 0.122123 0.148413 2024-09-16T16:53:23.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 16 5627 5611 0.842919 0.929688 0.118267 0.148068 2024-09-16T16:53:23.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:23.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:23.689+0000 7f0531a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:23.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:23.698+0000 7f0531a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:24.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 5726 5710 0.841607 0.773438 0.219032 0.148314 2024-09-16T16:53:24.719 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:24.719 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:24.719 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:24.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:24.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:24.844+0000 7fac73cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:24.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:24.856+0000 7fac73cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:24.938 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:24.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:24.941 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:24.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.065+0000 7f8d67ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:25.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.078+0000 7f8d67ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:25.201 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:25.201 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:25.201 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:25.201 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:25.201 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:25.201 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:25.202 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:25.202 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:25.202 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:25.202 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:25.202 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:25.202 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:25.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:25.206 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:25.206 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:25.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.372+0000 7efe7f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:25.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.386+0000 7efe7f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:25.474 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:25.475 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:25.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:25.478 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:25.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:25.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 5834 5818 0.841645 0.84375 0.117658 0.148305 2024-09-16T16:53:25.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.606+0000 7fce4d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:25.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.620+0000 7fce4d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:25.644 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:25.644 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:25.866 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.988+0000 7fbbe4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:25.996+0000 7fbbe4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:26.483 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 5942 5926 0.841682 0.84375 0.231447 0.148308 2024-09-16T16:53:27.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 6059 6043 0.842973 0.914062 0.172107 0.148007 2024-09-16T16:53:28.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:28.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:28.445+0000 7fee21551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:28.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:28.454+0000 7fee21551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:28.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 6170 6154 0.843396 0.867188 0.126546 0.148016 2024-09-16T16:53:29.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 6279 6263 0.843535 0.851562 0.178004 0.148014 2024-09-16T16:53:30.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 6374 6358 0.841816 0.742188 0.0434972 0.148298 2024-09-16T16:53:30.645 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:30.645 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:30.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:30.782+0000 7f75e3874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:30.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:30.793+0000 7f75e3874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:30.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:31.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:31.014+0000 7f9f96311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:31.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:31.022+0000 7f9f96311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:31.116 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:53:31.116 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:53:31.137 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-16T16:53:30.441112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47391283,"num_objects":719,"num_object_clones":0,"num_object_copies":2157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5794,"num_write_kb":46812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5768,"ondisk_log_size":5768,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":286620,"kb_used_data":286620,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208904292,"statfs":{"total":214211493888,"available":213917995008,"internally_reserved":0,"allocated":293498880,"data_stored":293498880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26509312,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3236,"num_write_kb":25888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002377"},"pg_stats":[{"pgid":"6.f","version":"44'272","reported_seq":284,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.823759+0000","last_change":"2024-09-16T16:52:30.561960+0000","last_active":"2024-09-16T16:53:22.823759+0000","last_peered":"2024-09-16T16:53:22.823759+0000","last_clean":"2024-09-16T16:53:22.823759+0000","last_became_active":"2024-09-16T16:52:30.550642+0000","last_became_peered":"2024-09-16T16:52:30.550642+0000","last_unstale":"2024-09-16T16:53:22.823759+0000","last_undegraded":"2024-09-16T16:53:22.823759+0000","last_fullsized":"2024-09-16T16:53:22.823759+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"44'296","reported_seq":308,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.527608+0000","last_change":"2024-09-16T16:52:30.539031+0000","last_active":"2024-09-16T16:53:23.527608+0000","last_peered":"2024-09-16T16:53:23.527608+0000","last_clean":"2024-09-16T16:53:23.527608+0000","last_became_active":"2024-09-16T16:52:30.520980+0000","last_became_peered":"2024-09-16T16:52:30.520980+0000","last_unstale":"2024-09-16T16:53:23.527608+0000","last_undegraded":"2024-09-16T16:53:23.527608+0000","last_fullsized":"2024-09-16T16:53:23.527608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"44'400","reported_seq":412,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.203816+0000","last_change":"2024-09-16T16:52:30.569209+0000","last_active":"2024-09-16T16:53:23.203816+0000","last_peered":"2024-09-16T16:53:23.203816+0000","last_clean":"2024-09-16T16:53:23.203816+0000","last_became_active":"2024-09-16T16:52:30.553224+0000","last_became_peered":"2024-09-16T16:52:30.553224+0000","last_unstale":"2024-09-16T16:53:23.203816+0000","last_undegraded":"2024-09-16T16:53:23.203816+0000","last_fullsized":"2024-09-16T16:53:23.203816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"44'264","reported_seq":276,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:18.923922+0000","last_change":"2024-09-16T16:52:30.581450+0000","last_active":"2024-09-16T16:53:18.923922+0000","last_peered":"2024-09-16T16:53:18.923922+0000","last_clean":"2024-09-16T16:53:18.923922+0000","last_became_active":"2024-09-16T16:52:30.573533+0000","last_became_peered":"2024-09-16T16:52:30.573533+0000","last_unstale":"2024-09-16T16:53:18.923922+0000","last_undegraded":"2024-09-16T16:53:18.923922+0000","last_fullsized":"2024-09-16T16:53:18.923922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'392","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.411113+0000","last_change":"2024-09-16T16:52:30.552895+0000","last_active":"2024-09-16T16:53:23.411113+0000","last_peered":"2024-09-16T16:53:23.411113+0000","last_clean":"2024-09-16T16:53:23.411113+0000","last_became_active":"2024-09-16T16:52:30.529127+0000","last_became_peered":"2024-09-16T16:52:30.529127+0000","last_unstale":"2024-09-16T16:53:23.411113+0000","last_undegraded":"2024-09-16T16:53:23.411113+0000","last_fullsized":"2024-09-16T16:53:23.411113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"44'369","reported_seq":381,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.653261+0000","last_change":"2024-09-16T16:52:30.536577+0000","last_active":"2024-09-16T16:53:22.653261+0000","last_peered":"2024-09-16T16:53:22.653261+0000","last_clean":"2024-09-16T16:53:22.653261+0000","last_became_active":"2024-09-16T16:52:30.525172+0000","last_became_peered":"2024-09-16T16:52:30.525172+0000","last_unstale":"2024-09-16T16:53:22.653261+0000","last_undegraded":"2024-09-16T16:53:22.653261+0000","last_fullsized":"2024-09-16T16:53:22.653261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3022848,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"44'368","reported_seq":380,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.984887+0000","last_change":"2024-09-16T16:52:30.522508+0000","last_active":"2024-09-16T16:53:22.984887+0000","last_peered":"2024-09-16T16:53:22.984887+0000","last_clean":"2024-09-16T16:53:22.984887+0000","last_became_active":"2024-09-16T16:52:30.510458+0000","last_became_peered":"2024-09-16T16:52:30.510458+0000","last_unstale":"2024-09-16T16:53:22.984887+0000","last_undegraded":"2024-09-16T16:53:22.984887+0000","last_fullsized":"2024-09-16T16:53:22.984887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"44'336","reported_seq":348,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:21.489396+0000","last_change":"2024-09-16T16:52:30.595812+0000","last_active":"2024-09-16T16:53:21.489396+0000","last_peered":"2024-09-16T16:53:21.489396+0000","last_clean":"2024-09-16T16:53:21.489396+0000","last_became_active":"2024-09-16T16:52:30.534721+0000","last_became_peered":"2024-09-16T16:52:30.534721+0000","last_unstale":"2024-09-16T16:53:21.489396+0000","last_undegraded":"2024-09-16T16:53:21.489396+0000","last_fullsized":"2024-09-16T16:53:21.489396+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'384","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.372036+0000","last_change":"2024-09-16T16:52:30.520663+0000","last_active":"2024-09-16T16:53:24.372036+0000","last_peered":"2024-09-16T16:53:24.372036+0000","last_clean":"2024-09-16T16:53:24.372036+0000","last_became_active":"2024-09-16T16:52:30.508854+0000","last_became_peered":"2024-09-16T16:52:30.508854+0000","last_unstale":"2024-09-16T16:53:24.372036+0000","last_undegraded":"2024-09-16T16:53:24.372036+0000","last_fullsized":"2024-09-16T16:53:24.372036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":172,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.407979+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:52:31.407979+0000","last_peered":"2024-09-16T16:52:31.407979+0000","last_clean":"2024-09-16T16:52:31.407979+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:52:31.407979+0000","last_undegraded":"2024-09-16T16:52:31.407979+0000","last_fullsized":"2024-09-16T16:52:31.407979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":98,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413184+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:52:31.413184+0000","last_peered":"2024-09-16T16:52:31.413184+0000","last_clean":"2024-09-16T16:52:31.413184+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:52:31.413184+0000","last_undegraded":"2024-09-16T16:52:31.413184+0000","last_fullsized":"2024-09-16T16:52:31.413184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"44'440","reported_seq":452,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.295351+0000","last_change":"2024-09-16T16:52:30.625723+0000","last_active":"2024-09-16T16:53:24.295351+0000","last_peered":"2024-09-16T16:53:24.295351+0000","last_clean":"2024-09-16T16:53:24.295351+0000","last_became_active":"2024-09-16T16:52:30.619486+0000","last_became_peered":"2024-09-16T16:52:30.619486+0000","last_unstale":"2024-09-16T16:53:24.295351+0000","last_undegraded":"2024-09-16T16:53:24.295351+0000","last_fullsized":"2024-09-16T16:53:24.295351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413103+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:52:31.413103+0000","last_peered":"2024-09-16T16:52:31.413103+0000","last_clean":"2024-09-16T16:52:31.413103+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:52:31.413103+0000","last_undegraded":"2024-09-16T16:52:31.413103+0000","last_fullsized":"2024-09-16T16:52:31.413103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"44'384","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.940846+0000","last_change":"2024-09-16T16:52:30.560847+0000","last_active":"2024-09-16T16:53:23.940846+0000","last_peered":"2024-09-16T16:53:23.940846+0000","last_clean":"2024-09-16T16:53:23.940846+0000","last_became_active":"2024-09-16T16:52:30.523734+0000","last_became_peered":"2024-09-16T16:52:30.523734+0000","last_unstale":"2024-09-16T16:53:23.940846+0000","last_undegraded":"2024-09-16T16:53:23.940846+0000","last_fullsized":"2024-09-16T16:53:23.940846+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.405471+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:52:31.405471+0000","last_peered":"2024-09-16T16:52:31.405471+0000","last_clean":"2024-09-16T16:52:31.405471+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:52:31.405471+0000","last_undegraded":"2024-09-16T16:52:31.405471+0000","last_fullsized":"2024-09-16T16:52:31.405471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"44'392","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.620214+0000","last_change":"2024-09-16T16:52:30.486241+0000","last_active":"2024-09-16T16:53:23.620214+0000","last_peered":"2024-09-16T16:53:23.620214+0000","last_clean":"2024-09-16T16:53:23.620214+0000","last_became_active":"2024-09-16T16:52:30.478327+0000","last_became_peered":"2024-09-16T16:52:30.478327+0000","last_unstale":"2024-09-16T16:53:23.620214+0000","last_undegraded":"2024-09-16T16:53:23.620214+0000","last_fullsized":"2024-09-16T16:53:23.620214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":99,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.407006+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:52:31.407006+0000","last_peered":"2024-09-16T16:52:31.407006+0000","last_clean":"2024-09-16T16:52:31.407006+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:52:31.407006+0000","last_undegraded":"2024-09-16T16:52:31.407006+0000","last_fullsized":"2024-09-16T16:52:31.407006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"44'344","reported_seq":356,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.474125+0000","last_change":"2024-09-16T16:52:30.531346+0000","last_active":"2024-09-16T16:53:22.474125+0000","last_peered":"2024-09-16T16:53:22.474125+0000","last_clean":"2024-09-16T16:53:22.474125+0000","last_became_active":"2024-09-16T16:52:30.499337+0000","last_became_peered":"2024-09-16T16:52:30.499337+0000","last_unstale":"2024-09-16T16:53:22.474125+0000","last_undegraded":"2024-09-16T16:53:22.474125+0000","last_fullsized":"2024-09-16T16:53:22.474125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413669+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:52:31.413669+0000","last_peered":"2024-09-16T16:52:31.413669+0000","last_clean":"2024-09-16T16:52:31.413669+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:52:31.413669+0000","last_undegraded":"2024-09-16T16:52:31.413669+0000","last_fullsized":"2024-09-16T16:52:31.413669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"44'312","reported_seq":324,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.146019+0000","last_change":"2024-09-16T16:52:30.582884+0000","last_active":"2024-09-16T16:53:24.146019+0000","last_peered":"2024-09-16T16:53:24.146019+0000","last_clean":"2024-09-16T16:53:24.146019+0000","last_became_active":"2024-09-16T16:52:30.575087+0000","last_became_peered":"2024-09-16T16:52:30.575087+0000","last_unstale":"2024-09-16T16:53:24.146019+0000","last_undegraded":"2024-09-16T16:53:24.146019+0000","last_fullsized":"2024-09-16T16:53:24.146019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.412215+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:52:31.412215+0000","last_peered":"2024-09-16T16:52:31.412215+0000","last_clean":"2024-09-16T16:52:31.412215+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:52:31.412215+0000","last_undegraded":"2024-09-16T16:52:31.412215+0000","last_fullsized":"2024-09-16T16:52:31.412215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"44'352","reported_seq":364,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.063555+0000","last_change":"2024-09-16T16:52:30.659248+0000","last_active":"2024-09-16T16:53:24.063555+0000","last_peered":"2024-09-16T16:53:24.063555+0000","last_clean":"2024-09-16T16:53:24.063555+0000","last_became_active":"2024-09-16T16:52:30.652888+0000","last_became_peered":"2024-09-16T16:52:30.652888+0000","last_unstale":"2024-09-16T16:53:24.063555+0000","last_undegraded":"2024-09-16T16:53:24.063555+0000","last_fullsized":"2024-09-16T16:53:24.063555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.412703+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:52:31.412703+0000","last_peered":"2024-09-16T16:52:31.412703+0000","last_clean":"2024-09-16T16:52:31.412703+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:52:31.412703+0000","last_undegraded":"2024-09-16T16:52:31.412703+0000","last_fullsized":"2024-09-16T16:52:31.412703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"44'408","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.849007+0000","last_change":"2024-09-16T16:52:30.597509+0000","last_active":"2024-09-16T16:53:23.849007+0000","last_peered":"2024-09-16T16:53:23.849007+0000","last_clean":"2024-09-16T16:53:23.849007+0000","last_became_active":"2024-09-16T16:52:30.585924+0000","last_became_peered":"2024-09-16T16:52:30.585924+0000","last_unstale":"2024-09-16T16:53:23.849007+0000","last_undegraded":"2024-09-16T16:53:23.849007+0000","last_fullsized":"2024-09-16T16:53:23.849007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.416555+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:52:31.416555+0000","last_peered":"2024-09-16T16:52:31.416555+0000","last_clean":"2024-09-16T16:52:31.416555+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:52:31.416555+0000","last_undegraded":"2024-09-16T16:52:31.416555+0000","last_fullsized":"2024-09-16T16:52:31.416555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":46800896,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5713,"num_write_kb":45704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213913862144,"internally_reserved":0,"allocated":297631744,"data_stored":297631744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5713,"ondisk_log_size":5713,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213913886720,"internally_reserved":0,"allocated":297607168,"data_stored":297607168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53481402368,"internally_reserved":0,"allocated":71471104,"data_stored":71471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":68832,"kb_used_data":68832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52228896,"statfs":{"total":53552873472,"available":53482389504,"internally_reserved":0,"allocated":70483968,"data_stored":70483968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":62740,"kb_used_data":62740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234988,"statfs":{"total":53552873472,"available":53488627712,"internally_reserved":0,"allocated":64245760,"data_stored":64245760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76692,"kb_used_data":76692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52221036,"statfs":{"total":53552873472,"available":53474340864,"internally_reserved":0,"allocated":78532608,"data_stored":78532608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":78356,"kb_used_data":78356,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52219372,"statfs":{"total":53552873472,"available":53472636928,"internally_reserved":0,"allocated":80236544,"data_stored":80236544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53481402368,"internally_reserved":0,"allocated":71471104,"data_stored":71471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53471371264,"internally_reserved":0,"allocated":81502208,"data_stored":81502208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53472878592,"internally_reserved":0,"allocated":79994880,"data_stored":79994880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53488234496,"internally_reserved":0,"allocated":64638976,"data_stored":64638976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53481402368,"internally_reserved":0,"allocated":71471104,"data_stored":71471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53471363072,"internally_reserved":0,"allocated":81510400,"data_stored":81510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53472878592,"internally_reserved":0,"allocated":79994880,"data_stored":79994880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53488234496,"internally_reserved":0,"allocated":64638976,"data_stored":64638976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53481385984,"internally_reserved":0,"allocated":71487488,"data_stored":71487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:31.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:53:31.484489+0000 min lat: 0.0213974 max lat: 0.866328 avg lat: 0.148497 2024-09-16T16:53:31.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:53:31.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 6470 6454 0.840285 0.75 0.168072 0.148497 2024-09-16T16:53:32.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 6582 6566 0.840852 0.875 0.132275 0.14843 2024-09-16T16:53:33.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:33.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:33.365+0000 7faa1fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:33.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:33.374+0000 7faa1fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:33.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6690 6674 0.840898 0.84375 0.106503 0.148427 2024-09-16T16:53:34.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 6789 6773 0.839826 0.773438 0.280936 0.148502 2024-09-16T16:53:35.484 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 16 6900 6884 0.840252 0.867188 0.153484 0.148545 2024-09-16T16:53:35.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:35.936+0000 7fda51791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:35.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:35.943+0000 7fda51791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.140 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:36.140 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:36.140 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:36.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:36.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.288+0000 7ff716791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.301+0000 7ff716791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:36.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:36.358 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:36.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:36.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 6992 6976 0.838382 0.71875 0.106467 0.148726 2024-09-16T16:53:36.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.484+0000 7f4cd3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.498+0000 7f4cd3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:36.572 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:36.576 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:36.576 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:36.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:36.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.703+0000 7f3e59ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.714+0000 7f3e59ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.829 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:36.830 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:36.831 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:36.833 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:36.833 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:36.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:36.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.984+0000 7f62792bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:36.997+0000 7f62792bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:37.029 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:37.029 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:37.029 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:37.029 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:37.029 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:37.029 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:37.030 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:37.030 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:37.030 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:37.030 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:37.030 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:37.030 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:37.034 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:37.034 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:37.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 7080 7064 0.836095 0.6875 0.129484 0.149308 2024-09-16T16:53:38.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:38.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:38.343+0000 7fd785791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:38.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:38.351+0000 7fd785791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:38.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 7179 7163 0.835158 0.773438 0.132371 0.149489 2024-09-16T16:53:39.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 7277 7261 0.834135 0.765625 0.217341 0.149659 2024-09-16T16:53:40.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 16 7387 7371 0.834499 0.859375 0.0800357 0.149613 2024-09-16T16:53:40.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:40.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:40.878+0000 7fcbf0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:40.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:40.886+0000 7fcbf0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:41.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 7489 7473 0.833961 0.796875 0.0773744 0.1496 2024-09-16T16:53:42.035 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:42.035 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:42.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:53:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:42.151+0000 7faf29911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:42.162+0000 7faf29911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:42.365 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:53:42.366 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:53:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-16T16:53:40.443064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47391283,"num_objects":719,"num_object_clones":0,"num_object_copies":2157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5794,"num_write_kb":46812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5768,"ondisk_log_size":5768,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":286620,"kb_used_data":286620,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208904292,"statfs":{"total":214211493888,"available":213917995008,"internally_reserved":0,"allocated":293498880,"data_stored":293498880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002369"},"pg_stats":[{"pgid":"6.f","version":"44'272","reported_seq":284,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.823759+0000","last_change":"2024-09-16T16:52:30.561960+0000","last_active":"2024-09-16T16:53:22.823759+0000","last_peered":"2024-09-16T16:53:22.823759+0000","last_clean":"2024-09-16T16:53:22.823759+0000","last_became_active":"2024-09-16T16:52:30.550642+0000","last_became_peered":"2024-09-16T16:52:30.550642+0000","last_unstale":"2024-09-16T16:53:22.823759+0000","last_undegraded":"2024-09-16T16:53:22.823759+0000","last_fullsized":"2024-09-16T16:53:22.823759+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"44'296","reported_seq":308,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.527608+0000","last_change":"2024-09-16T16:52:30.539031+0000","last_active":"2024-09-16T16:53:23.527608+0000","last_peered":"2024-09-16T16:53:23.527608+0000","last_clean":"2024-09-16T16:53:23.527608+0000","last_became_active":"2024-09-16T16:52:30.520980+0000","last_became_peered":"2024-09-16T16:52:30.520980+0000","last_unstale":"2024-09-16T16:53:23.527608+0000","last_undegraded":"2024-09-16T16:53:23.527608+0000","last_fullsized":"2024-09-16T16:53:23.527608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"44'400","reported_seq":412,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.203816+0000","last_change":"2024-09-16T16:52:30.569209+0000","last_active":"2024-09-16T16:53:23.203816+0000","last_peered":"2024-09-16T16:53:23.203816+0000","last_clean":"2024-09-16T16:53:23.203816+0000","last_became_active":"2024-09-16T16:52:30.553224+0000","last_became_peered":"2024-09-16T16:52:30.553224+0000","last_unstale":"2024-09-16T16:53:23.203816+0000","last_undegraded":"2024-09-16T16:53:23.203816+0000","last_fullsized":"2024-09-16T16:53:23.203816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"44'264","reported_seq":276,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:18.923922+0000","last_change":"2024-09-16T16:52:30.581450+0000","last_active":"2024-09-16T16:53:18.923922+0000","last_peered":"2024-09-16T16:53:18.923922+0000","last_clean":"2024-09-16T16:53:18.923922+0000","last_became_active":"2024-09-16T16:52:30.573533+0000","last_became_peered":"2024-09-16T16:52:30.573533+0000","last_unstale":"2024-09-16T16:53:18.923922+0000","last_undegraded":"2024-09-16T16:53:18.923922+0000","last_fullsized":"2024-09-16T16:53:18.923922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'392","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.411113+0000","last_change":"2024-09-16T16:52:30.552895+0000","last_active":"2024-09-16T16:53:23.411113+0000","last_peered":"2024-09-16T16:53:23.411113+0000","last_clean":"2024-09-16T16:53:23.411113+0000","last_became_active":"2024-09-16T16:52:30.529127+0000","last_became_peered":"2024-09-16T16:52:30.529127+0000","last_unstale":"2024-09-16T16:53:23.411113+0000","last_undegraded":"2024-09-16T16:53:23.411113+0000","last_fullsized":"2024-09-16T16:53:23.411113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"44'369","reported_seq":381,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.653261+0000","last_change":"2024-09-16T16:52:30.536577+0000","last_active":"2024-09-16T16:53:22.653261+0000","last_peered":"2024-09-16T16:53:22.653261+0000","last_clean":"2024-09-16T16:53:22.653261+0000","last_became_active":"2024-09-16T16:52:30.525172+0000","last_became_peered":"2024-09-16T16:52:30.525172+0000","last_unstale":"2024-09-16T16:53:22.653261+0000","last_undegraded":"2024-09-16T16:53:22.653261+0000","last_fullsized":"2024-09-16T16:53:22.653261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3022848,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"44'368","reported_seq":380,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.984887+0000","last_change":"2024-09-16T16:52:30.522508+0000","last_active":"2024-09-16T16:53:22.984887+0000","last_peered":"2024-09-16T16:53:22.984887+0000","last_clean":"2024-09-16T16:53:22.984887+0000","last_became_active":"2024-09-16T16:52:30.510458+0000","last_became_peered":"2024-09-16T16:52:30.510458+0000","last_unstale":"2024-09-16T16:53:22.984887+0000","last_undegraded":"2024-09-16T16:53:22.984887+0000","last_fullsized":"2024-09-16T16:53:22.984887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"44'336","reported_seq":348,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:21.489396+0000","last_change":"2024-09-16T16:52:30.595812+0000","last_active":"2024-09-16T16:53:21.489396+0000","last_peered":"2024-09-16T16:53:21.489396+0000","last_clean":"2024-09-16T16:53:21.489396+0000","last_became_active":"2024-09-16T16:52:30.534721+0000","last_became_peered":"2024-09-16T16:52:30.534721+0000","last_unstale":"2024-09-16T16:53:21.489396+0000","last_undegraded":"2024-09-16T16:53:21.489396+0000","last_fullsized":"2024-09-16T16:53:21.489396+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'384","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.372036+0000","last_change":"2024-09-16T16:52:30.520663+0000","last_active":"2024-09-16T16:53:24.372036+0000","last_peered":"2024-09-16T16:53:24.372036+0000","last_clean":"2024-09-16T16:53:24.372036+0000","last_became_active":"2024-09-16T16:52:30.508854+0000","last_became_peered":"2024-09-16T16:52:30.508854+0000","last_unstale":"2024-09-16T16:53:24.372036+0000","last_undegraded":"2024-09-16T16:53:24.372036+0000","last_fullsized":"2024-09-16T16:53:24.372036+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":172,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.407979+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:52:31.407979+0000","last_peered":"2024-09-16T16:52:31.407979+0000","last_clean":"2024-09-16T16:52:31.407979+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:52:31.407979+0000","last_undegraded":"2024-09-16T16:52:31.407979+0000","last_fullsized":"2024-09-16T16:52:31.407979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":98,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413184+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:52:31.413184+0000","last_peered":"2024-09-16T16:52:31.413184+0000","last_clean":"2024-09-16T16:52:31.413184+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:52:31.413184+0000","last_undegraded":"2024-09-16T16:52:31.413184+0000","last_fullsized":"2024-09-16T16:52:31.413184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"44'440","reported_seq":452,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.295351+0000","last_change":"2024-09-16T16:52:30.625723+0000","last_active":"2024-09-16T16:53:24.295351+0000","last_peered":"2024-09-16T16:53:24.295351+0000","last_clean":"2024-09-16T16:53:24.295351+0000","last_became_active":"2024-09-16T16:52:30.619486+0000","last_became_peered":"2024-09-16T16:52:30.619486+0000","last_unstale":"2024-09-16T16:53:24.295351+0000","last_undegraded":"2024-09-16T16:53:24.295351+0000","last_fullsized":"2024-09-16T16:53:24.295351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413103+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:52:31.413103+0000","last_peered":"2024-09-16T16:52:31.413103+0000","last_clean":"2024-09-16T16:52:31.413103+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:52:31.413103+0000","last_undegraded":"2024-09-16T16:52:31.413103+0000","last_fullsized":"2024-09-16T16:52:31.413103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"44'384","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.940846+0000","last_change":"2024-09-16T16:52:30.560847+0000","last_active":"2024-09-16T16:53:23.940846+0000","last_peered":"2024-09-16T16:53:23.940846+0000","last_clean":"2024-09-16T16:53:23.940846+0000","last_became_active":"2024-09-16T16:52:30.523734+0000","last_became_peered":"2024-09-16T16:52:30.523734+0000","last_unstale":"2024-09-16T16:53:23.940846+0000","last_undegraded":"2024-09-16T16:53:23.940846+0000","last_fullsized":"2024-09-16T16:53:23.940846+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.405471+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:52:31.405471+0000","last_peered":"2024-09-16T16:52:31.405471+0000","last_clean":"2024-09-16T16:52:31.405471+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:52:31.405471+0000","last_undegraded":"2024-09-16T16:52:31.405471+0000","last_fullsized":"2024-09-16T16:52:31.405471+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"44'392","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.620214+0000","last_change":"2024-09-16T16:52:30.486241+0000","last_active":"2024-09-16T16:53:23.620214+0000","last_peered":"2024-09-16T16:53:23.620214+0000","last_clean":"2024-09-16T16:53:23.620214+0000","last_became_active":"2024-09-16T16:52:30.478327+0000","last_became_peered":"2024-09-16T16:52:30.478327+0000","last_unstale":"2024-09-16T16:53:23.620214+0000","last_undegraded":"2024-09-16T16:53:23.620214+0000","last_fullsized":"2024-09-16T16:53:23.620214+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":99,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.407006+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:52:31.407006+0000","last_peered":"2024-09-16T16:52:31.407006+0000","last_clean":"2024-09-16T16:52:31.407006+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:52:31.407006+0000","last_undegraded":"2024-09-16T16:52:31.407006+0000","last_fullsized":"2024-09-16T16:52:31.407006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"44'344","reported_seq":356,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:22.474125+0000","last_change":"2024-09-16T16:52:30.531346+0000","last_active":"2024-09-16T16:53:22.474125+0000","last_peered":"2024-09-16T16:53:22.474125+0000","last_clean":"2024-09-16T16:53:22.474125+0000","last_became_active":"2024-09-16T16:52:30.499337+0000","last_became_peered":"2024-09-16T16:52:30.499337+0000","last_unstale":"2024-09-16T16:53:22.474125+0000","last_undegraded":"2024-09-16T16:53:22.474125+0000","last_fullsized":"2024-09-16T16:53:22.474125+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.413669+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:52:31.413669+0000","last_peered":"2024-09-16T16:52:31.413669+0000","last_clean":"2024-09-16T16:52:31.413669+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:52:31.413669+0000","last_undegraded":"2024-09-16T16:52:31.413669+0000","last_fullsized":"2024-09-16T16:52:31.413669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"44'312","reported_seq":324,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.146019+0000","last_change":"2024-09-16T16:52:30.582884+0000","last_active":"2024-09-16T16:53:24.146019+0000","last_peered":"2024-09-16T16:53:24.146019+0000","last_clean":"2024-09-16T16:53:24.146019+0000","last_became_active":"2024-09-16T16:52:30.575087+0000","last_became_peered":"2024-09-16T16:52:30.575087+0000","last_unstale":"2024-09-16T16:53:24.146019+0000","last_undegraded":"2024-09-16T16:53:24.146019+0000","last_fullsized":"2024-09-16T16:53:24.146019+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.412215+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:52:31.412215+0000","last_peered":"2024-09-16T16:52:31.412215+0000","last_clean":"2024-09-16T16:52:31.412215+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:52:31.412215+0000","last_undegraded":"2024-09-16T16:52:31.412215+0000","last_fullsized":"2024-09-16T16:52:31.412215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"44'352","reported_seq":364,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:24.063555+0000","last_change":"2024-09-16T16:52:30.659248+0000","last_active":"2024-09-16T16:53:24.063555+0000","last_peered":"2024-09-16T16:53:24.063555+0000","last_clean":"2024-09-16T16:53:24.063555+0000","last_became_active":"2024-09-16T16:52:30.652888+0000","last_became_peered":"2024-09-16T16:52:30.652888+0000","last_unstale":"2024-09-16T16:53:24.063555+0000","last_undegraded":"2024-09-16T16:53:24.063555+0000","last_fullsized":"2024-09-16T16:53:24.063555+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.412703+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:52:31.412703+0000","last_peered":"2024-09-16T16:52:31.412703+0000","last_clean":"2024-09-16T16:52:31.412703+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:52:31.412703+0000","last_undegraded":"2024-09-16T16:52:31.412703+0000","last_fullsized":"2024-09-16T16:52:31.412703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"44'408","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:53:23.849007+0000","last_change":"2024-09-16T16:52:30.597509+0000","last_active":"2024-09-16T16:53:23.849007+0000","last_peered":"2024-09-16T16:53:23.849007+0000","last_clean":"2024-09-16T16:53:23.849007+0000","last_became_active":"2024-09-16T16:52:30.585924+0000","last_became_peered":"2024-09-16T16:52:30.585924+0000","last_unstale":"2024-09-16T16:53:23.849007+0000","last_undegraded":"2024-09-16T16:53:23.849007+0000","last_fullsized":"2024-09-16T16:53:23.849007+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:52:29.372440+0000","last_clean_scrub_stamp":"2024-09-16T16:52:29.372440+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T16:52:31.416555+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:52:31.416555+0000","last_peered":"2024-09-16T16:52:31.416555+0000","last_clean":"2024-09-16T16:52:31.416555+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:52:31.416555+0000","last_undegraded":"2024-09-16T16:52:31.416555+0000","last_fullsized":"2024-09-16T16:52:31.416555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":46800896,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5713,"num_write_kb":45704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213913862144,"internally_reserved":0,"allocated":297631744,"data_stored":297631744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5713,"ondisk_log_size":5713,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213913886720,"internally_reserved":0,"allocated":297607168,"data_stored":297607168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53481402368,"internally_reserved":0,"allocated":71471104,"data_stored":71471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":68832,"kb_used_data":68832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52228896,"statfs":{"total":53552873472,"available":53482389504,"internally_reserved":0,"allocated":70483968,"data_stored":70483968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":62740,"kb_used_data":62740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234988,"statfs":{"total":53552873472,"available":53488627712,"internally_reserved":0,"allocated":64245760,"data_stored":64245760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76692,"kb_used_data":76692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52221036,"statfs":{"total":53552873472,"available":53474340864,"internally_reserved":0,"allocated":78532608,"data_stored":78532608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706054,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":78356,"kb_used_data":78356,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52219372,"statfs":{"total":53552873472,"available":53472636928,"internally_reserved":0,"allocated":80236544,"data_stored":80236544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53481402368,"internally_reserved":0,"allocated":71471104,"data_stored":71471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53471371264,"internally_reserved":0,"allocated":81502208,"data_stored":81502208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53472878592,"internally_reserved":0,"allocated":79994880,"data_stored":79994880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53488234496,"internally_reserved":0,"allocated":64638976,"data_stored":64638976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53481402368,"internally_reserved":0,"allocated":71471104,"data_stored":71471104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":53552873472,"available":53471363072,"internally_reserved":0,"allocated":81510400,"data_stored":81510400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":53552873472,"available":53472878592,"internally_reserved":0,"allocated":79994880,"data_stored":79994880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":53552873472,"available":53488234496,"internally_reserved":0,"allocated":64638976,"data_stored":64638976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":53552873472,"available":53481385984,"internally_reserved":0,"allocated":71487488,"data_stored":71487488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:53:42.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 7571 7555 0.831237 0.640625 0.308511 0.150025 2024-09-16T16:53:43.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:43.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:43.266+0000 7f7ba36e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:43.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:43.274+0000 7f7ba36e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:43.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7664 7648 0.829782 0.726562 0.170318 0.150471 2024-09-16T16:53:44.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 7778 7762 0.830614 0.890625 0.131976 0.150323 2024-09-16T16:53:45.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 7901 7885 0.832374 0.960938 0.0992677 0.150052 2024-09-16T16:53:45.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:45.902+0000 7fd3288d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:45.913+0000 7fd3288d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:46.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 8012 7996 0.832837 0.867188 0.186171 0.14989 2024-09-16T16:53:47.382 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:47.382 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:47.382 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:47.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:47.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 8121 8105 0.833083 0.851562 0.190943 0.149874 2024-09-16T16:53:47.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:47.505+0000 7f7b02191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:47.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:47.519+0000 7f7b02191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:47.542 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:47.543 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:47.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:47.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:47.673+0000 7f8ba60fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:47.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:47.687+0000 7f8ba60fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:47.709 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:47.710 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:47.714 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:47.714 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:47.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:47.854+0000 7f344ca6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:47.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:47.867+0000 7f344ca6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:47.944 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:47.945 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:47.948 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:47.948 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:47.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:48.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:48.068+0000 7f490cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:48.079+0000 7f490cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:48.101 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:48.102 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:48.105 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:48.106 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:48.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:48.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:48.439+0000 7f01b4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:48.450+0000 7f01b4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:48.485 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 8217 8201 0.832003 0.75 0.126308 0.150109 2024-09-16T16:53:49.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 8322 8306 0.831852 0.820312 0.0927452 0.150148 2024-09-16T16:53:50.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 8433 8417 0.832298 0.867188 0.296205 0.149998 2024-09-16T16:53:50.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:50.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:50.885+0000 7f9602463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:50.892+0000 7f9602463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:51.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:53:51.486399+0000 min lat: 0.0213974 max lat: 0.866328 avg lat: 0.150334 2024-09-16T16:53:51.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:53:51.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 8523 8507 0.830683 0.703125 0.140909 0.150334 2024-09-16T16:53:52.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 8599 8583 0.827757 0.59375 0.501968 0.150578 2024-09-16T16:53:53.107 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:53.107 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:53.107 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:53.108 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:53.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:53.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.240+0000 7f14ce151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.255+0000 7f14ce151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.298+0000 7f0e5c0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.306+0000 7f0e5c0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.329 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:53.330 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:53.333 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:53.334 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:53.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:53.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 16 8681 8665 0.825474 0.640625 0.149658 0.15127 2024-09-16T16:53:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.485+0000 7f5fe36fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.502+0000 7f5fe36fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:53.547 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:53.548 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:53.548 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:53.551 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:53.552 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:53.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:53.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.691+0000 7f35ebd08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.703+0000 7f35ebd08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:53.820 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:53.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:53.823 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:53.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:53.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.952+0000 7f8dbe2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:53.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:53.966+0000 7f8dbe2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:54.006 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:54.010 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:54.010 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:54.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 8770 8754 0.823905 0.695312 0.267734 0.15148 2024-09-16T16:53:55.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 8867 8851 0.823117 0.757812 0.0885104 0.151568 2024-09-16T16:53:55.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:53:55.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:55.886+0000 7f1dfe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:55.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:55.897+0000 7f1dfe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:56.487 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 8956 8940 0.821613 0.695312 0.251545 0.151909 2024-09-16T16:53:57.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 9056 9040 0.821143 0.78125 0.151635 0.152083 2024-09-16T16:53:58.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:53:58.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:58.368+0000 7f7649d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:58.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:58.376+0000 7f7649d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:58.486 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 9157 9141 0.820774 0.789062 0.204216 0.152141 2024-09-16T16:53:59.011 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:53:59.011 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:53:59.011 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:53:59.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:53:59.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.144+0000 7f7e542fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.156+0000 7f7e542fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:59.235 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:59.237 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:59.237 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:59.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:53:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.362+0000 7f6018391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.373+0000 7f6018391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:59.393 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:59.395 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:59.396 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:59.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:53:59.487 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 16 9250 9234 0.819702 0.726562 0.282573 0.152179 2024-09-16T16:53:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.530+0000 7f4374391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.543+0000 7f4374391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:59.629 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:59.629 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:53:59.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:53:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.776+0000 7faca1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:53:59.790+0000 7faca1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:53:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:53:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:53:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:53:59.832 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:53:59.833 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:53:59.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:53:59.836 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:00.487 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 9354 9338 0.81962 0.8125 0.0652608 0.152363 2024-09-16T16:54:00.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:00.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:00.862+0000 7f05258e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:00.870+0000 7f05258e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:01.487 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 15 9455 9440 0.819367 0.796875 0.146475 0.152401 2024-09-16T16:54:02.487 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.1351 2024-09-16T16:54:02.487 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 9455 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.819516 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.0999696 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 1.03125 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.59375 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 104 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 12.7961 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 132 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 76 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.15241 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.0839651 2024-09-16T16:54:02.488 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 0.866328 2024-09-16T16:54:02.489 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0213974 2024-09-16T16:54:02.526 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:54:03.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:03.443+0000 7f038eed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:03.454+0000 7f038eed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:04.837 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:04.837 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:04.837 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:04.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:05.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:04.995+0000 7f1f8ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:05.015+0000 7f1f8ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.148 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:05.148 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:05.148 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:05.148 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:05.149 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:05.157 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:05.157 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:05.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:05.328+0000 7f727d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:05.347+0000 7f7277fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.471 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:05.472 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:05.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:05.477 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:05.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:05.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:05.671+0000 7fc1b3991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:05.690+0000 7fc1b3991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:05.773 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:05.777 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:05.777 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:05.777 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:05.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:05.923+0000 7f44d2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:05.939+0000 7f44d2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:05.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:05.985 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:05.986 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:05.986 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:05.986 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:05.990 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:05.990 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:06.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:06.116+0000 7fc44b0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:06.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:06.127+0000 7fc44b0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:08.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:08.792+0000 7f89ff991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:08.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:08.804+0000 7f89ff991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:10.991 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:10.991 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:10.991 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:10.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:11.145 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:11.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.171+0000 7fb1e6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.189+0000 7fb1e6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:11.263 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:11.264 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:11.264 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:11.264 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:11.267 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:11.268 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:11.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.304+0000 7f43afad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.313+0000 7f43afad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.481+0000 7f1995711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.498+0000 7f1995711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.551 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:11.551 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:11.551 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:11.552 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:11.556 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:11.556 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:11.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.776+0000 7f8c06191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:11.795+0000 7f8c06191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:11.923 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:11.923 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:11.923 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:11.923 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:11.923 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:11.928 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:11.928 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:11.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:12.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:12.112+0000 7fedd1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:12.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:12.127+0000 7fedd1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:12.170 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:12.170 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:12.171 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:12.174 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:12.174 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:13.493 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1182 objects 2024-09-16T16:54:13.493 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :10.9669 2024-09-16T16:54:13.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:13.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:13.719+0000 7f68c5d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:13.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:13.725+0000 7f68c5d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:15.127 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-16T16:54:15.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-16T16:54:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:15.251+0000 7f05698d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:15.265+0000 7f05698d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:15.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:15.942+0000 7fc403591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:15.948+0000 7fc403591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_3' removed 2024-09-16T16:54:16.177 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:54:16.178 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:54:16.178 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-16T16:54:16.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-16T16:54:16.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:16.348+0000 7f8708591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:16.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:16.365+0000 7f8708591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.167 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_4' created 2024-09-16T16:54:17.175 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:17.175 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:17.175 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:17.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:17.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-16T16:54:17.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.316+0000 7fa257391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.331+0000 7fa257391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:17.354 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:17.354 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:17.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:17.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.365+0000 7fc18c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.380+0000 7fc18c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.467+0000 7f2e57874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.478+0000 7f2e57874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:17.502 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:17.502 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:17.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:17.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.650+0000 7f1c4ab08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.660+0000 7f1c4ab08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:17.679 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:17.680 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:17.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:17.682 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:17.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:17.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.791+0000 7f6749d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:17.800+0000 7f6749d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:17.817 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:17.817 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:17.817 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:17.817 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:17.817 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:17.817 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:17.818 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:17.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:17.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:17.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:17.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:17.818 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:17.820 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:17.821 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:18.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:18.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:18.164+0000 7f5c2b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:18.171 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-16T16:54:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:18.175+0000 7f5c2b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:19.192 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-16T16:54:19.195 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:54:19.195 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:54:19.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:54:19.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:54:19.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_47106 2024-09-16T16:54:19.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:54:19.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:54:20.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 102 86 0.671833 0.671875 0.133872 0.169321 2024-09-16T16:54:20.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:20.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:20.650+0000 7fe7f0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:20.658+0000 7fe7f0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:21.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 206 190 0.742128 0.8125 0.303496 0.154369 2024-09-16T16:54:22.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 328 312 0.812427 0.953125 0.172309 0.147607 2024-09-16T16:54:22.821 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:22.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:54:22.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:22.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:22.940+0000 7f0d30f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:22.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:22.953+0000 7f0d30f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:22.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:22.994+0000 7f93dbf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:23.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:23.005+0000 7f93dbf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:23.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 16 406 390 0.761651 0.609375 0.0878906 0.159686 2024-09-16T16:54:24.186 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:54:24.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:54:24.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 526 510 0.796805 0.9375 0.231112 0.151684 2024-09-16T16:54:24.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:24.323+0000 7f8dd2c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:24.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:24.337+0000 7f8dd2c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:25.187 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:54:25.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:54:25.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 616 600 0.78118 0.703125 0.0452973 0.156757 2024-09-16T16:54:25.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:25.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:25.394+0000 7f76f426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:25.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:25.408+0000 7f76f426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:25.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:25.488+0000 7f776b4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:25.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:25.496+0000 7f776b4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:54:26.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:54:26.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 720 704 0.785644 0.8125 0.196478 0.156114 2024-09-16T16:54:26.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:26.338+0000 7f1b256a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:26.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:26.354+0000 7f1b256a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:54:27.215 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:54:27.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:27.265 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 831 815 0.795827 0.867188 0.101965 0.155438 2024-09-16T16:54:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:27.371+0000 7f4364f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:27.381+0000 7f4364f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:27.594 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:54:27.595 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:54:27.618 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-16T16:54:27.198116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4989491,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":618,"num_write_kb":5404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":592,"ondisk_log_size":592,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":31484,"kb_used_data":31484,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209159428,"statfs":{"total":214211493888,"available":214179254272,"internally_reserved":0,"allocated":32239616,"data_stored":32239616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.746761"},"pg_stats":[{"pgid":"7.f","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211889+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:54:24.211889+0000","last_peered":"2024-09-16T16:54:24.211889+0000","last_clean":"2024-09-16T16:54:24.211889+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:54:24.211889+0000","last_undegraded":"2024-09-16T16:54:24.211889+0000","last_fullsized":"2024-09-16T16:54:24.211889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256815+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:54:24.256815+0000","last_peered":"2024-09-16T16:54:24.256815+0000","last_clean":"2024-09-16T16:54:24.256815+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:54:24.256815+0000","last_undegraded":"2024-09-16T16:54:24.256815+0000","last_fullsized":"2024-09-16T16:54:24.256815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206413+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:54:24.206413+0000","last_peered":"2024-09-16T16:54:24.206413+0000","last_clean":"2024-09-16T16:54:24.206413+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:54:24.206413+0000","last_undegraded":"2024-09-16T16:54:24.206413+0000","last_fullsized":"2024-09-16T16:54:24.206413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209186+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:54:24.209186+0000","last_peered":"2024-09-16T16:54:24.209186+0000","last_clean":"2024-09-16T16:54:24.209186+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:54:24.209186+0000","last_undegraded":"2024-09-16T16:54:24.209186+0000","last_fullsized":"2024-09-16T16:54:24.209186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211351+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:54:24.211351+0000","last_peered":"2024-09-16T16:54:24.211351+0000","last_clean":"2024-09-16T16:54:24.211351+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:54:24.211351+0000","last_undegraded":"2024-09-16T16:54:24.211351+0000","last_fullsized":"2024-09-16T16:54:24.211351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"49'64","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.369456+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:54:24.369456+0000","last_peered":"2024-09-16T16:54:24.369456+0000","last_clean":"2024-09-16T16:54:24.369456+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:54:24.369456+0000","last_undegraded":"2024-09-16T16:54:24.369456+0000","last_fullsized":"2024-09-16T16:54:24.369456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209587+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:54:24.209587+0000","last_peered":"2024-09-16T16:54:24.209587+0000","last_clean":"2024-09-16T16:54:24.209587+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:54:24.209587+0000","last_undegraded":"2024-09-16T16:54:24.209587+0000","last_fullsized":"2024-09-16T16:54:24.209587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252373+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:54:24.252373+0000","last_peered":"2024-09-16T16:54:24.252373+0000","last_clean":"2024-09-16T16:54:24.252373+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:54:24.252373+0000","last_undegraded":"2024-09-16T16:54:24.252373+0000","last_fullsized":"2024-09-16T16:54:24.252373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"49'25","reported_seq":40,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215935+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:54:24.215935+0000","last_peered":"2024-09-16T16:54:24.215935+0000","last_clean":"2024-09-16T16:54:24.215935+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:54:24.215935+0000","last_undegraded":"2024-09-16T16:54:24.215935+0000","last_fullsized":"2024-09-16T16:54:24.215935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204800,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206537+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:24.206537+0000","last_peered":"2024-09-16T16:54:24.206537+0000","last_clean":"2024-09-16T16:54:24.206537+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:24.206537+0000","last_undegraded":"2024-09-16T16:54:24.206537+0000","last_fullsized":"2024-09-16T16:54:24.206537+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256870+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:24.256870+0000","last_peered":"2024-09-16T16:54:24.256870+0000","last_clean":"2024-09-16T16:54:24.256870+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:24.256870+0000","last_undegraded":"2024-09-16T16:54:24.256870+0000","last_fullsized":"2024-09-16T16:54:24.256870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.257269+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:54:24.257269+0000","last_peered":"2024-09-16T16:54:24.257269+0000","last_clean":"2024-09-16T16:54:24.257269+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:54:24.257269+0000","last_undegraded":"2024-09-16T16:54:24.257269+0000","last_fullsized":"2024-09-16T16:54:24.257269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.213413+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:24.213413+0000","last_peered":"2024-09-16T16:54:24.213413+0000","last_clean":"2024-09-16T16:54:24.213413+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:24.213413+0000","last_undegraded":"2024-09-16T16:54:24.213413+0000","last_fullsized":"2024-09-16T16:54:24.213413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"48'80","reported_seq":95,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.210706+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:54:24.210706+0000","last_peered":"2024-09-16T16:54:24.210706+0000","last_clean":"2024-09-16T16:54:24.210706+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:54:24.210706+0000","last_undegraded":"2024-09-16T16:54:24.210706+0000","last_fullsized":"2024-09-16T16:54:24.210706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252828+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:24.252828+0000","last_peered":"2024-09-16T16:54:24.252828+0000","last_clean":"2024-09-16T16:54:24.252828+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:24.252828+0000","last_undegraded":"2024-09-16T16:54:24.252828+0000","last_fullsized":"2024-09-16T16:54:24.252828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"49'48","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.275406+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:54:24.275406+0000","last_peered":"2024-09-16T16:54:24.275406+0000","last_clean":"2024-09-16T16:54:24.275406+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:54:24.275406+0000","last_undegraded":"2024-09-16T16:54:24.275406+0000","last_fullsized":"2024-09-16T16:54:24.275406+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":114,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208490+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:24.208490+0000","last_peered":"2024-09-16T16:54:24.208490+0000","last_clean":"2024-09-16T16:54:24.208490+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:24.208490+0000","last_undegraded":"2024-09-16T16:54:24.208490+0000","last_fullsized":"2024-09-16T16:54:24.208490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"48'72","reported_seq":87,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214660+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:54:24.214660+0000","last_peered":"2024-09-16T16:54:24.214660+0000","last_clean":"2024-09-16T16:54:24.214660+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:54:24.214660+0000","last_undegraded":"2024-09-16T16:54:24.214660+0000","last_fullsized":"2024-09-16T16:54:24.214660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208723+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:24.208723+0000","last_peered":"2024-09-16T16:54:24.208723+0000","last_clean":"2024-09-16T16:54:24.208723+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:24.208723+0000","last_undegraded":"2024-09-16T16:54:24.208723+0000","last_fullsized":"2024-09-16T16:54:24.208723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.203755+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:54:24.203755+0000","last_peered":"2024-09-16T16:54:24.203755+0000","last_clean":"2024-09-16T16:54:24.203755+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:54:24.203755+0000","last_undegraded":"2024-09-16T16:54:24.203755+0000","last_fullsized":"2024-09-16T16:54:24.203755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214325+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:24.214325+0000","last_peered":"2024-09-16T16:54:24.214325+0000","last_clean":"2024-09-16T16:54:24.214325+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:24.214325+0000","last_undegraded":"2024-09-16T16:54:24.214325+0000","last_fullsized":"2024-09-16T16:54:24.214325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"48'56","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.207770+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:54:24.207770+0000","last_peered":"2024-09-16T16:54:24.207770+0000","last_clean":"2024-09-16T16:54:24.207770+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:54:24.207770+0000","last_undegraded":"2024-09-16T16:54:24.207770+0000","last_fullsized":"2024-09-16T16:54:24.207770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209981+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:24.209981+0000","last_peered":"2024-09-16T16:54:24.209981+0000","last_clean":"2024-09-16T16:54:24.209981+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:24.209981+0000","last_undegraded":"2024-09-16T16:54:24.209981+0000","last_fullsized":"2024-09-16T16:54:24.209981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215667+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:54:24.215667+0000","last_peered":"2024-09-16T16:54:24.215667+0000","last_clean":"2024-09-16T16:54:24.215667+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:54:24.215667+0000","last_undegraded":"2024-09-16T16:54:24.215667+0000","last_fullsized":"2024-09-16T16:54:24.215667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256132+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:24.256132+0000","last_peered":"2024-09-16T16:54:24.256132+0000","last_clean":"2024-09-16T16:54:24.256132+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:24.256132+0000","last_undegraded":"2024-09-16T16:54:24.256132+0000","last_fullsized":"2024-09-16T16:54:24.256132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":537,"ondisk_log_size":537,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9352,"kb_used_data":9352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288376,"statfs":{"total":53552873472,"available":53543297024,"internally_reserved":0,"allocated":9576448,"data_stored":9576448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7628,"kb_used_data":7628,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290100,"statfs":{"total":53552873472,"available":53545062400,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6268,"kb_used_data":6268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291460,"statfs":{"total":53552873472,"available":53546455040,"internally_reserved":0,"allocated":6418432,"data_stored":6418432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8236,"kb_used_data":8236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289492,"statfs":{"total":53552873472,"available":53544439808,"internally_reserved":0,"allocated":8433664,"data_stored":8433664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:27.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:27.755+0000 7fa70d446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:27.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:27.768+0000 7fa70d446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:27.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:28.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.013+0000 7f9b9f511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.021+0000 7f9b9f511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.074 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:54:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:54:28.091 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-16T16:54:27.198116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4989491,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":618,"num_write_kb":5404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":592,"ondisk_log_size":592,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":31484,"kb_used_data":31484,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209159428,"statfs":{"total":214211493888,"available":214179254272,"internally_reserved":0,"allocated":32239616,"data_stored":32239616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.746761"},"pg_stats":[{"pgid":"7.f","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211889+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:54:24.211889+0000","last_peered":"2024-09-16T16:54:24.211889+0000","last_clean":"2024-09-16T16:54:24.211889+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:54:24.211889+0000","last_undegraded":"2024-09-16T16:54:24.211889+0000","last_fullsized":"2024-09-16T16:54:24.211889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256815+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:54:24.256815+0000","last_peered":"2024-09-16T16:54:24.256815+0000","last_clean":"2024-09-16T16:54:24.256815+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:54:24.256815+0000","last_undegraded":"2024-09-16T16:54:24.256815+0000","last_fullsized":"2024-09-16T16:54:24.256815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206413+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:54:24.206413+0000","last_peered":"2024-09-16T16:54:24.206413+0000","last_clean":"2024-09-16T16:54:24.206413+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:54:24.206413+0000","last_undegraded":"2024-09-16T16:54:24.206413+0000","last_fullsized":"2024-09-16T16:54:24.206413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209186+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:54:24.209186+0000","last_peered":"2024-09-16T16:54:24.209186+0000","last_clean":"2024-09-16T16:54:24.209186+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:54:24.209186+0000","last_undegraded":"2024-09-16T16:54:24.209186+0000","last_fullsized":"2024-09-16T16:54:24.209186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211351+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:54:24.211351+0000","last_peered":"2024-09-16T16:54:24.211351+0000","last_clean":"2024-09-16T16:54:24.211351+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:54:24.211351+0000","last_undegraded":"2024-09-16T16:54:24.211351+0000","last_fullsized":"2024-09-16T16:54:24.211351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"49'64","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.369456+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:54:24.369456+0000","last_peered":"2024-09-16T16:54:24.369456+0000","last_clean":"2024-09-16T16:54:24.369456+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:54:24.369456+0000","last_undegraded":"2024-09-16T16:54:24.369456+0000","last_fullsized":"2024-09-16T16:54:24.369456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209587+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:54:24.209587+0000","last_peered":"2024-09-16T16:54:24.209587+0000","last_clean":"2024-09-16T16:54:24.209587+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:54:24.209587+0000","last_undegraded":"2024-09-16T16:54:24.209587+0000","last_fullsized":"2024-09-16T16:54:24.209587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252373+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:54:24.252373+0000","last_peered":"2024-09-16T16:54:24.252373+0000","last_clean":"2024-09-16T16:54:24.252373+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:54:24.252373+0000","last_undegraded":"2024-09-16T16:54:24.252373+0000","last_fullsized":"2024-09-16T16:54:24.252373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"49'25","reported_seq":40,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215935+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:54:24.215935+0000","last_peered":"2024-09-16T16:54:24.215935+0000","last_clean":"2024-09-16T16:54:24.215935+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:54:24.215935+0000","last_undegraded":"2024-09-16T16:54:24.215935+0000","last_fullsized":"2024-09-16T16:54:24.215935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204800,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206537+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:24.206537+0000","last_peered":"2024-09-16T16:54:24.206537+0000","last_clean":"2024-09-16T16:54:24.206537+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:24.206537+0000","last_undegraded":"2024-09-16T16:54:24.206537+0000","last_fullsized":"2024-09-16T16:54:24.206537+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256870+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:24.256870+0000","last_peered":"2024-09-16T16:54:24.256870+0000","last_clean":"2024-09-16T16:54:24.256870+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:24.256870+0000","last_undegraded":"2024-09-16T16:54:24.256870+0000","last_fullsized":"2024-09-16T16:54:24.256870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.257269+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:54:24.257269+0000","last_peered":"2024-09-16T16:54:24.257269+0000","last_clean":"2024-09-16T16:54:24.257269+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:54:24.257269+0000","last_undegraded":"2024-09-16T16:54:24.257269+0000","last_fullsized":"2024-09-16T16:54:24.257269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.213413+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:24.213413+0000","last_peered":"2024-09-16T16:54:24.213413+0000","last_clean":"2024-09-16T16:54:24.213413+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:24.213413+0000","last_undegraded":"2024-09-16T16:54:24.213413+0000","last_fullsized":"2024-09-16T16:54:24.213413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"48'80","reported_seq":95,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.210706+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:54:24.210706+0000","last_peered":"2024-09-16T16:54:24.210706+0000","last_clean":"2024-09-16T16:54:24.210706+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:54:24.210706+0000","last_undegraded":"2024-09-16T16:54:24.210706+0000","last_fullsized":"2024-09-16T16:54:24.210706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252828+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:24.252828+0000","last_peered":"2024-09-16T16:54:24.252828+0000","last_clean":"2024-09-16T16:54:24.252828+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:24.252828+0000","last_undegraded":"2024-09-16T16:54:24.252828+0000","last_fullsized":"2024-09-16T16:54:24.252828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"49'48","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.275406+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:54:24.275406+0000","last_peered":"2024-09-16T16:54:24.275406+0000","last_clean":"2024-09-16T16:54:24.275406+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:54:24.275406+0000","last_undegraded":"2024-09-16T16:54:24.275406+0000","last_fullsized":"2024-09-16T16:54:24.275406+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":114,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208490+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:24.208490+0000","last_peered":"2024-09-16T16:54:24.208490+0000","last_clean":"2024-09-16T16:54:24.208490+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:24.208490+0000","last_undegraded":"2024-09-16T16:54:24.208490+0000","last_fullsized":"2024-09-16T16:54:24.208490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"48'72","reported_seq":87,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214660+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:54:24.214660+0000","last_peered":"2024-09-16T16:54:24.214660+0000","last_clean":"2024-09-16T16:54:24.214660+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:54:24.214660+0000","last_undegraded":"2024-09-16T16:54:24.214660+0000","last_fullsized":"2024-09-16T16:54:24.214660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208723+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:24.208723+0000","last_peered":"2024-09-16T16:54:24.208723+0000","last_clean":"2024-09-16T16:54:24.208723+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:24.208723+0000","last_undegraded":"2024-09-16T16:54:24.208723+0000","last_fullsized":"2024-09-16T16:54:24.208723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.203755+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:54:24.203755+0000","last_peered":"2024-09-16T16:54:24.203755+0000","last_clean":"2024-09-16T16:54:24.203755+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:54:24.203755+0000","last_undegraded":"2024-09-16T16:54:24.203755+0000","last_fullsized":"2024-09-16T16:54:24.203755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214325+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:24.214325+0000","last_peered":"2024-09-16T16:54:24.214325+0000","last_clean":"2024-09-16T16:54:24.214325+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:24.214325+0000","last_undegraded":"2024-09-16T16:54:24.214325+0000","last_fullsized":"2024-09-16T16:54:24.214325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"48'56","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.207770+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:54:24.207770+0000","last_peered":"2024-09-16T16:54:24.207770+0000","last_clean":"2024-09-16T16:54:24.207770+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:54:24.207770+0000","last_undegraded":"2024-09-16T16:54:24.207770+0000","last_fullsized":"2024-09-16T16:54:24.207770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209981+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:24.209981+0000","last_peered":"2024-09-16T16:54:24.209981+0000","last_clean":"2024-09-16T16:54:24.209981+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:24.209981+0000","last_undegraded":"2024-09-16T16:54:24.209981+0000","last_fullsized":"2024-09-16T16:54:24.209981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215667+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:54:24.215667+0000","last_peered":"2024-09-16T16:54:24.215667+0000","last_clean":"2024-09-16T16:54:24.215667+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:54:24.215667+0000","last_undegraded":"2024-09-16T16:54:24.215667+0000","last_fullsized":"2024-09-16T16:54:24.215667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256132+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:24.256132+0000","last_peered":"2024-09-16T16:54:24.256132+0000","last_clean":"2024-09-16T16:54:24.256132+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:24.256132+0000","last_undegraded":"2024-09-16T16:54:24.256132+0000","last_fullsized":"2024-09-16T16:54:24.256132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":537,"ondisk_log_size":537,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9352,"kb_used_data":9352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288376,"statfs":{"total":53552873472,"available":53543297024,"internally_reserved":0,"allocated":9576448,"data_stored":9576448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7628,"kb_used_data":7628,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290100,"statfs":{"total":53552873472,"available":53545062400,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6268,"kb_used_data":6268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291460,"statfs":{"total":53552873472,"available":53546455040,"internally_reserved":0,"allocated":6418432,"data_stored":6418432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8236,"kb_used_data":8236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289492,"statfs":{"total":53552873472,"available":53544439808,"internally_reserved":0,"allocated":8433664,"data_stored":8433664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:28.093 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:54:28.093 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:28.093 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:28.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:28.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.249+0000 7ff3e3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 928 912 0.791595 0.757812 0.0749422 0.157089 2024-09-16T16:54:28.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.267+0000 7ff3e3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:28.300 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:28.300 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:28.306 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:28.307 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:28.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:28.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.443+0000 7f403c2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.459+0000 7f403c2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:28.488 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:28.489 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:28.489 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:28.489 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:28.489 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:28.489 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:28.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:28.494 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:28.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:28.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.671+0000 7f40bc64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.683+0000 7f40bc64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.709 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:28.710 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:28.714 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:28.715 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:28.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:28.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.839+0000 7f6a29191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:28.851+0000 7f6a29191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:28.905 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:28.908 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:28.908 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:29.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 1035 1019 0.796021 0.835938 0.387378 0.155253 2024-09-16T16:54:30.211 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:30.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1128 1112 0.7897 0.726562 0.0459468 0.157319 2024-09-16T16:54:30.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:30.335+0000 7fe45a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:30.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:30.344+0000 7fe45a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:31.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1222 1206 0.785084 0.734375 0.259471 0.157879 2024-09-16T16:54:32.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1359 1343 0.807017 1.07031 0.0767463 0.153717 2024-09-16T16:54:32.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:32.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:32.694+0000 7f4cfbb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:32.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:32.702+0000 7f4cfbb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:33.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1460 1444 0.805728 0.789062 0.0803422 0.15418 2024-09-16T16:54:33.909 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:33.909 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:33.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:34.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:34.028+0000 7fb7562d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:34.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:34.040+0000 7fb7562d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:34.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1555 1539 0.801487 0.742188 0.102189 0.154964 2024-09-16T16:54:34.299 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:54:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:54:34.314 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-16T16:54:32.453303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4989491,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":618,"num_write_kb":5404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":592,"ondisk_log_size":592,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":31484,"kb_used_data":31484,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209159428,"statfs":{"total":214211493888,"available":214179254272,"internally_reserved":0,"allocated":32239616,"data_stored":32239616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.265409"},"pg_stats":[{"pgid":"7.f","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211889+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:54:24.211889+0000","last_peered":"2024-09-16T16:54:24.211889+0000","last_clean":"2024-09-16T16:54:24.211889+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:54:24.211889+0000","last_undegraded":"2024-09-16T16:54:24.211889+0000","last_fullsized":"2024-09-16T16:54:24.211889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256815+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:54:24.256815+0000","last_peered":"2024-09-16T16:54:24.256815+0000","last_clean":"2024-09-16T16:54:24.256815+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:54:24.256815+0000","last_undegraded":"2024-09-16T16:54:24.256815+0000","last_fullsized":"2024-09-16T16:54:24.256815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206413+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:54:24.206413+0000","last_peered":"2024-09-16T16:54:24.206413+0000","last_clean":"2024-09-16T16:54:24.206413+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:54:24.206413+0000","last_undegraded":"2024-09-16T16:54:24.206413+0000","last_fullsized":"2024-09-16T16:54:24.206413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209186+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:54:24.209186+0000","last_peered":"2024-09-16T16:54:24.209186+0000","last_clean":"2024-09-16T16:54:24.209186+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:54:24.209186+0000","last_undegraded":"2024-09-16T16:54:24.209186+0000","last_fullsized":"2024-09-16T16:54:24.209186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211351+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:54:24.211351+0000","last_peered":"2024-09-16T16:54:24.211351+0000","last_clean":"2024-09-16T16:54:24.211351+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:54:24.211351+0000","last_undegraded":"2024-09-16T16:54:24.211351+0000","last_fullsized":"2024-09-16T16:54:24.211351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"49'64","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.369456+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:54:24.369456+0000","last_peered":"2024-09-16T16:54:24.369456+0000","last_clean":"2024-09-16T16:54:24.369456+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:54:24.369456+0000","last_undegraded":"2024-09-16T16:54:24.369456+0000","last_fullsized":"2024-09-16T16:54:24.369456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209587+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:54:24.209587+0000","last_peered":"2024-09-16T16:54:24.209587+0000","last_clean":"2024-09-16T16:54:24.209587+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:54:24.209587+0000","last_undegraded":"2024-09-16T16:54:24.209587+0000","last_fullsized":"2024-09-16T16:54:24.209587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252373+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:54:24.252373+0000","last_peered":"2024-09-16T16:54:24.252373+0000","last_clean":"2024-09-16T16:54:24.252373+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:54:24.252373+0000","last_undegraded":"2024-09-16T16:54:24.252373+0000","last_fullsized":"2024-09-16T16:54:24.252373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"49'25","reported_seq":40,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215935+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:54:24.215935+0000","last_peered":"2024-09-16T16:54:24.215935+0000","last_clean":"2024-09-16T16:54:24.215935+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:54:24.215935+0000","last_undegraded":"2024-09-16T16:54:24.215935+0000","last_fullsized":"2024-09-16T16:54:24.215935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204800,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206537+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:24.206537+0000","last_peered":"2024-09-16T16:54:24.206537+0000","last_clean":"2024-09-16T16:54:24.206537+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:24.206537+0000","last_undegraded":"2024-09-16T16:54:24.206537+0000","last_fullsized":"2024-09-16T16:54:24.206537+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256870+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:24.256870+0000","last_peered":"2024-09-16T16:54:24.256870+0000","last_clean":"2024-09-16T16:54:24.256870+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:24.256870+0000","last_undegraded":"2024-09-16T16:54:24.256870+0000","last_fullsized":"2024-09-16T16:54:24.256870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.257269+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:54:24.257269+0000","last_peered":"2024-09-16T16:54:24.257269+0000","last_clean":"2024-09-16T16:54:24.257269+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:54:24.257269+0000","last_undegraded":"2024-09-16T16:54:24.257269+0000","last_fullsized":"2024-09-16T16:54:24.257269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.213413+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:24.213413+0000","last_peered":"2024-09-16T16:54:24.213413+0000","last_clean":"2024-09-16T16:54:24.213413+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:24.213413+0000","last_undegraded":"2024-09-16T16:54:24.213413+0000","last_fullsized":"2024-09-16T16:54:24.213413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"48'80","reported_seq":95,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.210706+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:54:24.210706+0000","last_peered":"2024-09-16T16:54:24.210706+0000","last_clean":"2024-09-16T16:54:24.210706+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:54:24.210706+0000","last_undegraded":"2024-09-16T16:54:24.210706+0000","last_fullsized":"2024-09-16T16:54:24.210706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252828+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:24.252828+0000","last_peered":"2024-09-16T16:54:24.252828+0000","last_clean":"2024-09-16T16:54:24.252828+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:24.252828+0000","last_undegraded":"2024-09-16T16:54:24.252828+0000","last_fullsized":"2024-09-16T16:54:24.252828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"49'48","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.275406+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:54:24.275406+0000","last_peered":"2024-09-16T16:54:24.275406+0000","last_clean":"2024-09-16T16:54:24.275406+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:54:24.275406+0000","last_undegraded":"2024-09-16T16:54:24.275406+0000","last_fullsized":"2024-09-16T16:54:24.275406+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":114,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208490+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:24.208490+0000","last_peered":"2024-09-16T16:54:24.208490+0000","last_clean":"2024-09-16T16:54:24.208490+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:24.208490+0000","last_undegraded":"2024-09-16T16:54:24.208490+0000","last_fullsized":"2024-09-16T16:54:24.208490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"48'72","reported_seq":87,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214660+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:54:24.214660+0000","last_peered":"2024-09-16T16:54:24.214660+0000","last_clean":"2024-09-16T16:54:24.214660+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:54:24.214660+0000","last_undegraded":"2024-09-16T16:54:24.214660+0000","last_fullsized":"2024-09-16T16:54:24.214660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208723+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:24.208723+0000","last_peered":"2024-09-16T16:54:24.208723+0000","last_clean":"2024-09-16T16:54:24.208723+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:24.208723+0000","last_undegraded":"2024-09-16T16:54:24.208723+0000","last_fullsized":"2024-09-16T16:54:24.208723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.203755+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:54:24.203755+0000","last_peered":"2024-09-16T16:54:24.203755+0000","last_clean":"2024-09-16T16:54:24.203755+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:54:24.203755+0000","last_undegraded":"2024-09-16T16:54:24.203755+0000","last_fullsized":"2024-09-16T16:54:24.203755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214325+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:24.214325+0000","last_peered":"2024-09-16T16:54:24.214325+0000","last_clean":"2024-09-16T16:54:24.214325+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:24.214325+0000","last_undegraded":"2024-09-16T16:54:24.214325+0000","last_fullsized":"2024-09-16T16:54:24.214325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"48'56","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.207770+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:54:24.207770+0000","last_peered":"2024-09-16T16:54:24.207770+0000","last_clean":"2024-09-16T16:54:24.207770+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:54:24.207770+0000","last_undegraded":"2024-09-16T16:54:24.207770+0000","last_fullsized":"2024-09-16T16:54:24.207770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209981+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:24.209981+0000","last_peered":"2024-09-16T16:54:24.209981+0000","last_clean":"2024-09-16T16:54:24.209981+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:24.209981+0000","last_undegraded":"2024-09-16T16:54:24.209981+0000","last_fullsized":"2024-09-16T16:54:24.209981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215667+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:54:24.215667+0000","last_peered":"2024-09-16T16:54:24.215667+0000","last_clean":"2024-09-16T16:54:24.215667+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:54:24.215667+0000","last_undegraded":"2024-09-16T16:54:24.215667+0000","last_fullsized":"2024-09-16T16:54:24.215667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256132+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:24.256132+0000","last_peered":"2024-09-16T16:54:24.256132+0000","last_clean":"2024-09-16T16:54:24.256132+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:24.256132+0000","last_undegraded":"2024-09-16T16:54:24.256132+0000","last_fullsized":"2024-09-16T16:54:24.256132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":537,"ondisk_log_size":537,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9352,"kb_used_data":9352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288376,"statfs":{"total":53552873472,"available":53543297024,"internally_reserved":0,"allocated":9576448,"data_stored":9576448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7628,"kb_used_data":7628,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290100,"statfs":{"total":53552873472,"available":53545062400,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6268,"kb_used_data":6268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291460,"statfs":{"total":53552873472,"available":53546455040,"internally_reserved":0,"allocated":6418432,"data_stored":6418432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8236,"kb_used_data":8236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289492,"statfs":{"total":53552873472,"available":53544439808,"internally_reserved":0,"allocated":8433664,"data_stored":8433664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:35.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:35.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:35.173+0000 7fd00786c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:35.181+0000 7fd00786c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:35.266 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1656 1640 0.800707 0.789062 0.171028 0.15398 2024-09-16T16:54:36.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1782 1766 0.811506 0.984375 0.121161 0.153647 2024-09-16T16:54:37.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 1890 1874 0.813293 0.84375 0.188818 0.152552 2024-09-16T16:54:37.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:37.492+0000 7f724e246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:37.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:37.502+0000 7f724e246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:38.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 1987 1971 0.810369 0.757812 0.159403 0.153465 2024-09-16T16:54:39.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:54:39.267295+0000 min lat: 0.0207673 max lat: 0.663908 avg lat: 0.152502 2024-09-16T16:54:39.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:54:39.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2106 2090 0.816331 0.929688 0.252554 0.152502 2024-09-16T16:54:39.317 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:39.317 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:39.317 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:39.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:39.440+0000 7fed1d0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:39.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:39.452+0000 7fed1d0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:39.527 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:39.527 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:39.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:39.650+0000 7fe815511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:39.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:39.663+0000 7fe815511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:39.691 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:39.692 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:39.695 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:39.696 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:39.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:39.816+0000 7f44d5c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:39.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:39.827+0000 7f44d5c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:39.860 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:39.860 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:39.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:39.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:40.007+0000 7f11c8cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:40.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:40.022+0000 7f11c8cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:40.056 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:40.056 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:40.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:40.066+0000 7f327f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:40.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:40.074+0000 7f327f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:40.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 16 2200 2184 0.812424 0.734375 0.230705 0.152948 2024-09-16T16:54:41.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2311 2295 0.81491 0.867188 0.0504605 0.152722 2024-09-16T16:54:42.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:42.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2415 2399 0.814802 0.8125 0.173823 0.152661 2024-09-16T16:54:42.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:42.366+0000 7f6bfcd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:42.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:42.377+0000 7f6bf759e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:43.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2525 2509 0.816656 0.859375 0.200055 0.152205 2024-09-16T16:54:44.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2637 2621 0.818986 0.875 0.184007 0.151895 2024-09-16T16:54:44.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:44.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:44.763+0000 7f86bacbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:44.772+0000 7f86bacbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.057 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:45.057 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:45.057 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:45.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:45.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.183+0000 7f7db5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.200+0000 7f7db5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.267 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 2740 2724 0.818433 0.804688 0.18303 0.152271 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:45.301 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:45.301 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:45.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.438+0000 7f6ab6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.449+0000 7f6ab6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:45.472 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:45.473 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:45.476 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:45.477 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:45.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.618+0000 7fed3b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.631+0000 7fed3b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.658 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:45.658 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:45.658 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:45.658 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:45.658 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:45.659 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:45.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:45.663 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:45.663 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:45.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.785+0000 7fa0a0311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:45.798+0000 7fa0a0311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:45.855 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:45.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:45.859 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:46.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 2842 2826 0.817633 0.796875 0.0853554 0.152049 2024-09-16T16:54:47.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:47.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:47.179+0000 7fdb44191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:47.188+0000 7fdb44191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:47.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 2974 2958 0.825259 1.03125 0.0985779 0.15108 2024-09-16T16:54:48.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 3083 3067 0.826164 0.851562 0.0966916 0.151001 2024-09-16T16:54:49.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 3171 3155 0.82154 0.6875 0.165236 0.151717 2024-09-16T16:54:49.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:49.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:49.595+0000 7f6544d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:49.603+0000 7f6544d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:50.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3267 3251 0.819229 0.75 0.207731 0.151857 2024-09-16T16:54:50.860 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:50.860 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:50.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:54:50.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:50.975+0000 7ff159cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:50.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:50.987+0000 7ff159cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:51.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3362 3346 0.816819 0.742188 0.20209 0.152483 2024-09-16T16:54:51.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:54:51.373 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:54:51.396 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-16T16:54:50.456593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4989491,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":618,"num_write_kb":5404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":592,"ondisk_log_size":592,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":31484,"kb_used_data":31484,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209159428,"statfs":{"total":214211493888,"available":214179254272,"internally_reserved":0,"allocated":32239616,"data_stored":32239616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002191"},"pg_stats":[{"pgid":"7.f","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211889+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:54:24.211889+0000","last_peered":"2024-09-16T16:54:24.211889+0000","last_clean":"2024-09-16T16:54:24.211889+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:54:24.211889+0000","last_undegraded":"2024-09-16T16:54:24.211889+0000","last_fullsized":"2024-09-16T16:54:24.211889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256815+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:54:24.256815+0000","last_peered":"2024-09-16T16:54:24.256815+0000","last_clean":"2024-09-16T16:54:24.256815+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:54:24.256815+0000","last_undegraded":"2024-09-16T16:54:24.256815+0000","last_fullsized":"2024-09-16T16:54:24.256815+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206413+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:54:24.206413+0000","last_peered":"2024-09-16T16:54:24.206413+0000","last_clean":"2024-09-16T16:54:24.206413+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:54:24.206413+0000","last_undegraded":"2024-09-16T16:54:24.206413+0000","last_fullsized":"2024-09-16T16:54:24.206413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209186+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:54:24.209186+0000","last_peered":"2024-09-16T16:54:24.209186+0000","last_clean":"2024-09-16T16:54:24.209186+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:54:24.209186+0000","last_undegraded":"2024-09-16T16:54:24.209186+0000","last_fullsized":"2024-09-16T16:54:24.209186+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.211351+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:54:24.211351+0000","last_peered":"2024-09-16T16:54:24.211351+0000","last_clean":"2024-09-16T16:54:24.211351+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:54:24.211351+0000","last_undegraded":"2024-09-16T16:54:24.211351+0000","last_fullsized":"2024-09-16T16:54:24.211351+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"49'64","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.369456+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:54:24.369456+0000","last_peered":"2024-09-16T16:54:24.369456+0000","last_clean":"2024-09-16T16:54:24.369456+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:54:24.369456+0000","last_undegraded":"2024-09-16T16:54:24.369456+0000","last_fullsized":"2024-09-16T16:54:24.369456+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209587+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:54:24.209587+0000","last_peered":"2024-09-16T16:54:24.209587+0000","last_clean":"2024-09-16T16:54:24.209587+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:54:24.209587+0000","last_undegraded":"2024-09-16T16:54:24.209587+0000","last_fullsized":"2024-09-16T16:54:24.209587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252373+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:54:24.252373+0000","last_peered":"2024-09-16T16:54:24.252373+0000","last_clean":"2024-09-16T16:54:24.252373+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:54:24.252373+0000","last_undegraded":"2024-09-16T16:54:24.252373+0000","last_fullsized":"2024-09-16T16:54:24.252373+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"49'25","reported_seq":40,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215935+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:54:24.215935+0000","last_peered":"2024-09-16T16:54:24.215935+0000","last_clean":"2024-09-16T16:54:24.215935+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:54:24.215935+0000","last_undegraded":"2024-09-16T16:54:24.215935+0000","last_fullsized":"2024-09-16T16:54:24.215935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204800,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.206537+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:24.206537+0000","last_peered":"2024-09-16T16:54:24.206537+0000","last_clean":"2024-09-16T16:54:24.206537+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:24.206537+0000","last_undegraded":"2024-09-16T16:54:24.206537+0000","last_fullsized":"2024-09-16T16:54:24.206537+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":113,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256870+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:24.256870+0000","last_peered":"2024-09-16T16:54:24.256870+0000","last_clean":"2024-09-16T16:54:24.256870+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:24.256870+0000","last_undegraded":"2024-09-16T16:54:24.256870+0000","last_fullsized":"2024-09-16T16:54:24.256870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"48'24","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.257269+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:54:24.257269+0000","last_peered":"2024-09-16T16:54:24.257269+0000","last_clean":"2024-09-16T16:54:24.257269+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:54:24.257269+0000","last_undegraded":"2024-09-16T16:54:24.257269+0000","last_fullsized":"2024-09-16T16:54:24.257269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.213413+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:24.213413+0000","last_peered":"2024-09-16T16:54:24.213413+0000","last_clean":"2024-09-16T16:54:24.213413+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:24.213413+0000","last_undegraded":"2024-09-16T16:54:24.213413+0000","last_fullsized":"2024-09-16T16:54:24.213413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"48'80","reported_seq":95,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.210706+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:54:24.210706+0000","last_peered":"2024-09-16T16:54:24.210706+0000","last_clean":"2024-09-16T16:54:24.210706+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:54:24.210706+0000","last_undegraded":"2024-09-16T16:54:24.210706+0000","last_fullsized":"2024-09-16T16:54:24.210706+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.252828+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:24.252828+0000","last_peered":"2024-09-16T16:54:24.252828+0000","last_clean":"2024-09-16T16:54:24.252828+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:24.252828+0000","last_undegraded":"2024-09-16T16:54:24.252828+0000","last_fullsized":"2024-09-16T16:54:24.252828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"49'48","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.275406+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:54:24.275406+0000","last_peered":"2024-09-16T16:54:24.275406+0000","last_clean":"2024-09-16T16:54:24.275406+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:54:24.275406+0000","last_undegraded":"2024-09-16T16:54:24.275406+0000","last_fullsized":"2024-09-16T16:54:24.275406+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":114,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208490+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:24.208490+0000","last_peered":"2024-09-16T16:54:24.208490+0000","last_clean":"2024-09-16T16:54:24.208490+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:24.208490+0000","last_undegraded":"2024-09-16T16:54:24.208490+0000","last_fullsized":"2024-09-16T16:54:24.208490+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"48'72","reported_seq":87,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214660+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:54:24.214660+0000","last_peered":"2024-09-16T16:54:24.214660+0000","last_clean":"2024-09-16T16:54:24.214660+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:54:24.214660+0000","last_undegraded":"2024-09-16T16:54:24.214660+0000","last_fullsized":"2024-09-16T16:54:24.214660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.208723+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:24.208723+0000","last_peered":"2024-09-16T16:54:24.208723+0000","last_clean":"2024-09-16T16:54:24.208723+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:24.208723+0000","last_undegraded":"2024-09-16T16:54:24.208723+0000","last_fullsized":"2024-09-16T16:54:24.208723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"48'40","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.203755+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:54:24.203755+0000","last_peered":"2024-09-16T16:54:24.203755+0000","last_clean":"2024-09-16T16:54:24.203755+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:54:24.203755+0000","last_undegraded":"2024-09-16T16:54:24.203755+0000","last_fullsized":"2024-09-16T16:54:24.203755+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.214325+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:24.214325+0000","last_peered":"2024-09-16T16:54:24.214325+0000","last_clean":"2024-09-16T16:54:24.214325+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:24.214325+0000","last_undegraded":"2024-09-16T16:54:24.214325+0000","last_fullsized":"2024-09-16T16:54:24.214325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"48'56","reported_seq":71,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.207770+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:54:24.207770+0000","last_peered":"2024-09-16T16:54:24.207770+0000","last_clean":"2024-09-16T16:54:24.207770+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:54:24.207770+0000","last_undegraded":"2024-09-16T16:54:24.207770+0000","last_fullsized":"2024-09-16T16:54:24.207770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.209981+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:24.209981+0000","last_peered":"2024-09-16T16:54:24.209981+0000","last_clean":"2024-09-16T16:54:24.209981+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:24.209981+0000","last_undegraded":"2024-09-16T16:54:24.209981+0000","last_fullsized":"2024-09-16T16:54:24.209981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"48'16","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.215667+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:54:24.215667+0000","last_peered":"2024-09-16T16:54:24.215667+0000","last_clean":"2024-09-16T16:54:24.215667+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:54:24.215667+0000","last_undegraded":"2024-09-16T16:54:24.215667+0000","last_fullsized":"2024-09-16T16:54:24.215667+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T16:54:24.256132+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:24.256132+0000","last_peered":"2024-09-16T16:54:24.256132+0000","last_clean":"2024-09-16T16:54:24.256132+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:24.256132+0000","last_undegraded":"2024-09-16T16:54:24.256132+0000","last_fullsized":"2024-09-16T16:54:24.256132+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":537,"ondisk_log_size":537,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214174871552,"internally_reserved":0,"allocated":36622336,"data_stored":36622336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":9352,"kb_used_data":9352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288376,"statfs":{"total":53552873472,"available":53543297024,"internally_reserved":0,"allocated":9576448,"data_stored":9576448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":7628,"kb_used_data":7628,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290100,"statfs":{"total":53552873472,"available":53545062400,"internally_reserved":0,"allocated":7811072,"data_stored":7811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6268,"kb_used_data":6268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291460,"statfs":{"total":53552873472,"available":53546455040,"internally_reserved":0,"allocated":6418432,"data_stored":6418432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8236,"kb_used_data":8236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289492,"statfs":{"total":53552873472,"available":53544439808,"internally_reserved":0,"allocated":8433664,"data_stored":8433664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53543337984,"internally_reserved":0,"allocated":9535488,"data_stored":9535488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53545418752,"internally_reserved":0,"allocated":7454720,"data_stored":7454720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53544546304,"internally_reserved":0,"allocated":8327168,"data_stored":8327168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53541568512,"internally_reserved":0,"allocated":11304960,"data_stored":11304960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:54:51.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:52.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:52.091+0000 7f40a1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:52.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:52.099+0000 7f40a1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:52.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3440 3424 0.810531 0.609375 0.1064 0.153637 2024-09-16T16:54:53.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3524 3508 0.805992 0.65625 0.758955 0.154777 2024-09-16T16:54:54.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 3630 3614 0.806622 0.828125 0.0559254 0.154714 2024-09-16T16:54:54.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:54.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:54.540+0000 7fc817474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:54.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:54.548+0000 7fc817474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:55.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 3743 3727 0.808736 0.882812 0.10921 0.154296 2024-09-16T16:54:56.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 3847 3831 0.808836 0.8125 0.104094 0.154148 2024-09-16T16:54:56.397 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:54:56.398 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:54:56.398 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:54:56.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:54:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.521+0000 7efdf9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:56.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.535+0000 7efdf9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:56.597 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:56.602 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:56.602 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:56.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:54:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.744+0000 7f96d6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:56.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.757+0000 7f96d6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:56.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:54:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:56.802 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:56.803 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:56.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:54:56.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.931+0000 7f1921f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:56.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.943+0000 7f1921f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:56.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.969+0000 7f0f5ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:56.981+0000 7f0f5ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:57.105 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:57.105 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:57.105 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:57.105 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:57.105 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:57.105 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:57.106 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:57.106 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:57.106 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:57.106 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:57.106 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:57.106 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:57.109 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:57.109 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:57.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:54:57.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:57.243+0000 7ff61dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:57.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:57.257+0000 7ff61dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:57.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 3948 3932 0.808314 0.789062 0.139629 0.154308 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:54:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:54:57.361 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:54:57.361 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:54:58.268 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 4060 4044 0.810022 0.875 0.210676 0.153864 2024-09-16T16:54:59.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:54:59.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:54:59.269102+0000 min lat: 0.0207673 max lat: 0.791977 avg lat: 0.15361 2024-09-16T16:54:59.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:54:59.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4175 4159 0.812231 0.898438 0.12603 0.15361 2024-09-16T16:54:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:59.389+0000 7fc0bf86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:54:59.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:54:59.397+0000 7fc0bf86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:00.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4271 4255 0.810711 0.75 0.291599 0.153818 2024-09-16T16:55:01.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4388 4372 0.813169 0.914062 0.149392 0.153431 2024-09-16T16:55:01.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:01.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:01.714+0000 7f1a2af51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:01.723+0000 7f1a2af51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:02.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4493 4477 0.813333 0.820312 0.18744 0.153295 2024-09-16T16:55:02.362 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:02.362 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:02.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:02.490+0000 7fc1a5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:02.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:02.501+0000 7fc1a5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:02.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:55:02.764 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:55:02.781 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-16T16:55:02.458861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30433843,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3724,"num_write_kb":30252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3698,"ondisk_log_size":3698,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":183932,"kb_used_data":183932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209006980,"statfs":{"total":214211493888,"available":214023147520,"internally_reserved":0,"allocated":188346368,"data_stored":188346368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25444352,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3106,"num_write_kb":24848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002268"},"pg_stats":[{"pgid":"7.f","version":"52'280","reported_seq":304,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:52.818130+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:54:52.818130+0000","last_peered":"2024-09-16T16:54:52.818130+0000","last_clean":"2024-09-16T16:54:52.818130+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:54:52.818130+0000","last_undegraded":"2024-09-16T16:54:52.818130+0000","last_fullsized":"2024-09-16T16:54:52.818130+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"52'200","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.336294+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:54:54.336294+0000","last_peered":"2024-09-16T16:54:54.336294+0000","last_clean":"2024-09-16T16:54:54.336294+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:54:54.336294+0000","last_undegraded":"2024-09-16T16:54:54.336294+0000","last_fullsized":"2024-09-16T16:54:54.336294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"52'200","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:49.400996+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:54:49.400996+0000","last_peered":"2024-09-16T16:54:49.400996+0000","last_clean":"2024-09-16T16:54:49.400996+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:54:49.400996+0000","last_undegraded":"2024-09-16T16:54:49.400996+0000","last_fullsized":"2024-09-16T16:54:49.400996+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"52'184","reported_seq":208,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.244757+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:54:54.244757+0000","last_peered":"2024-09-16T16:54:54.244757+0000","last_clean":"2024-09-16T16:54:54.244757+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:54:54.244757+0000","last_undegraded":"2024-09-16T16:54:54.244757+0000","last_fullsized":"2024-09-16T16:54:54.244757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"52'240","reported_seq":264,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:52.490313+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:54:52.490313+0000","last_peered":"2024-09-16T16:54:52.490313+0000","last_clean":"2024-09-16T16:54:52.490313+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:54:52.490313+0000","last_undegraded":"2024-09-16T16:54:52.490313+0000","last_fullsized":"2024-09-16T16:54:52.490313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"52'248","reported_seq":272,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.017748+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:54:54.017748+0000","last_peered":"2024-09-16T16:54:54.017748+0000","last_clean":"2024-09-16T16:54:54.017748+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:54:54.017748+0000","last_undegraded":"2024-09-16T16:54:54.017748+0000","last_fullsized":"2024-09-16T16:54:54.017748+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"52'248","reported_seq":272,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.311392+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:54:53.311392+0000","last_peered":"2024-09-16T16:54:53.311392+0000","last_clean":"2024-09-16T16:54:53.311392+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:54:53.311392+0000","last_undegraded":"2024-09-16T16:54:53.311392+0000","last_fullsized":"2024-09-16T16:54:53.311392+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"52'208","reported_seq":232,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.653203+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:54:53.653203+0000","last_peered":"2024-09-16T16:54:53.653203+0000","last_clean":"2024-09-16T16:54:53.653203+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:54:53.653203+0000","last_undegraded":"2024-09-16T16:54:53.653203+0000","last_fullsized":"2024-09-16T16:54:53.653203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"52'136","reported_seq":160,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.298090+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:54:54.298090+0000","last_peered":"2024-09-16T16:54:54.298090+0000","last_clean":"2024-09-16T16:54:54.298090+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:54:54.298090+0000","last_undegraded":"2024-09-16T16:54:54.298090+0000","last_fullsized":"2024-09-16T16:54:54.298090+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"52'259","reported_seq":283,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.362454+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:54:54.362454+0000","last_peered":"2024-09-16T16:54:54.362454+0000","last_clean":"2024-09-16T16:54:54.362454+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:54:54.362454+0000","last_undegraded":"2024-09-16T16:54:54.362454+0000","last_fullsized":"2024-09-16T16:54:54.362454+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2121728,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":2072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"52'288","reported_seq":312,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.761052+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:54:53.761052+0000","last_peered":"2024-09-16T16:54:53.761052+0000","last_clean":"2024-09-16T16:54:53.761052+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:54:53.761052+0000","last_undegraded":"2024-09-16T16:54:53.761052+0000","last_fullsized":"2024-09-16T16:54:53.761052+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"52'232","reported_seq":256,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.388451+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:54:53.388451+0000","last_peered":"2024-09-16T16:54:53.388451+0000","last_clean":"2024-09-16T16:54:53.388451+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:54:53.388451+0000","last_undegraded":"2024-09-16T16:54:53.388451+0000","last_fullsized":"2024-09-16T16:54:53.388451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"52'248","reported_seq":272,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.202637+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:54:54.202637+0000","last_peered":"2024-09-16T16:54:54.202637+0000","last_clean":"2024-09-16T16:54:54.202637+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:54:54.202637+0000","last_undegraded":"2024-09-16T16:54:54.202637+0000","last_fullsized":"2024-09-16T16:54:54.202637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"52'184","reported_seq":208,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.930930+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:54:53.930930+0000","last_peered":"2024-09-16T16:54:53.930930+0000","last_clean":"2024-09-16T16:54:53.930930+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:54:53.930930+0000","last_undegraded":"2024-09-16T16:54:53.930930+0000","last_fullsized":"2024-09-16T16:54:53.930930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"52'272","reported_seq":296,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.715683+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:54:53.715683+0000","last_peered":"2024-09-16T16:54:53.715683+0000","last_clean":"2024-09-16T16:54:53.715683+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:54:53.715683+0000","last_undegraded":"2024-09-16T16:54:53.715683+0000","last_fullsized":"2024-09-16T16:54:53.715683+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"52'216","reported_seq":240,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.139674+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:54:54.139674+0000","last_peered":"2024-09-16T16:54:54.139674+0000","last_clean":"2024-09-16T16:54:54.139674+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:54:54.139674+0000","last_undegraded":"2024-09-16T16:54:54.139674+0000","last_fullsized":"2024-09-16T16:54:54.139674+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":29843456,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3643,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214019162112,"internally_reserved":0,"allocated":192331776,"data_stored":192331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214019162112,"internally_reserved":0,"allocated":192331776,"data_stored":192331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57368,"kb_used_data":57368,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52240360,"statfs":{"total":53552873472,"available":53494128640,"internally_reserved":0,"allocated":58744832,"data_stored":58744832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":35768,"kb_used_data":35768,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52261960,"statfs":{"total":53552873472,"available":53516247040,"internally_reserved":0,"allocated":36626432,"data_stored":36626432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":46940,"kb_used_data":46940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52250788,"statfs":{"total":53552873472,"available":53504806912,"internally_reserved":0,"allocated":48066560,"data_stored":48066560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":43856,"kb_used_data":43856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52253872,"statfs":{"total":53552873472,"available":53507964928,"internally_reserved":0,"allocated":44908544,"data_stored":44908544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53507227648,"internally_reserved":0,"allocated":45645824,"data_stored":45645824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53503922176,"internally_reserved":0,"allocated":48951296,"data_stored":48951296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53515341824,"internally_reserved":0,"allocated":37531648,"data_stored":37531648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53507227648,"internally_reserved":0,"allocated":45645824,"data_stored":45645824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53503922176,"internally_reserved":0,"allocated":48951296,"data_stored":48951296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53515341824,"internally_reserved":0,"allocated":37531648,"data_stored":37531648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:03.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 16 4609 4593 0.815443 0.90625 0.140324 0.153037 2024-09-16T16:55:03.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:04.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:04.036+0000 7fd0a6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:04.044+0000 7fd0a6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:04.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 4703 4687 0.81364 0.734375 0.0931144 0.153373 2024-09-16T16:55:05.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 4814 4798 0.814802 0.867188 0.118891 0.153189 2024-09-16T16:55:06.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:06.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 16 4933 4917 0.817244 0.929688 0.106562 0.152721 2024-09-16T16:55:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:06.396+0000 7f3d44991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:06.404+0000 7f3d44991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:07.269 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 5039 5023 0.817469 0.828125 0.180712 0.152659 2024-09-16T16:55:07.783 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:07.783 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:07.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:07.921+0000 7fb9cbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:07.932+0000 7fb9cbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:08.144 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:55:08.153 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:55:08.165 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-16T16:55:06.459594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30433843,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3724,"num_write_kb":30252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3698,"ondisk_log_size":3698,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":183932,"kb_used_data":183932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209006980,"statfs":{"total":214211493888,"available":214023147520,"internally_reserved":0,"allocated":188346368,"data_stored":188346368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002283"},"pg_stats":[{"pgid":"7.f","version":"52'280","reported_seq":304,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:52.818130+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:54:52.818130+0000","last_peered":"2024-09-16T16:54:52.818130+0000","last_clean":"2024-09-16T16:54:52.818130+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:54:52.818130+0000","last_undegraded":"2024-09-16T16:54:52.818130+0000","last_fullsized":"2024-09-16T16:54:52.818130+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"52'200","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.336294+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:54:54.336294+0000","last_peered":"2024-09-16T16:54:54.336294+0000","last_clean":"2024-09-16T16:54:54.336294+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:54:54.336294+0000","last_undegraded":"2024-09-16T16:54:54.336294+0000","last_fullsized":"2024-09-16T16:54:54.336294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"52'200","reported_seq":224,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:49.400996+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:54:49.400996+0000","last_peered":"2024-09-16T16:54:49.400996+0000","last_clean":"2024-09-16T16:54:49.400996+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:54:49.400996+0000","last_undegraded":"2024-09-16T16:54:49.400996+0000","last_fullsized":"2024-09-16T16:54:49.400996+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"52'184","reported_seq":208,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.244757+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:54:54.244757+0000","last_peered":"2024-09-16T16:54:54.244757+0000","last_clean":"2024-09-16T16:54:54.244757+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:54:54.244757+0000","last_undegraded":"2024-09-16T16:54:54.244757+0000","last_fullsized":"2024-09-16T16:54:54.244757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"52'240","reported_seq":264,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:52.490313+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:54:52.490313+0000","last_peered":"2024-09-16T16:54:52.490313+0000","last_clean":"2024-09-16T16:54:52.490313+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:54:52.490313+0000","last_undegraded":"2024-09-16T16:54:52.490313+0000","last_fullsized":"2024-09-16T16:54:52.490313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"52'248","reported_seq":272,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.017748+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:54:54.017748+0000","last_peered":"2024-09-16T16:54:54.017748+0000","last_clean":"2024-09-16T16:54:54.017748+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:54:54.017748+0000","last_undegraded":"2024-09-16T16:54:54.017748+0000","last_fullsized":"2024-09-16T16:54:54.017748+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"52'248","reported_seq":272,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.311392+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:54:53.311392+0000","last_peered":"2024-09-16T16:54:53.311392+0000","last_clean":"2024-09-16T16:54:53.311392+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:54:53.311392+0000","last_undegraded":"2024-09-16T16:54:53.311392+0000","last_fullsized":"2024-09-16T16:54:53.311392+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"52'208","reported_seq":232,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.653203+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:54:53.653203+0000","last_peered":"2024-09-16T16:54:53.653203+0000","last_clean":"2024-09-16T16:54:53.653203+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:54:53.653203+0000","last_undegraded":"2024-09-16T16:54:53.653203+0000","last_fullsized":"2024-09-16T16:54:53.653203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"52'136","reported_seq":160,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.298090+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:54:54.298090+0000","last_peered":"2024-09-16T16:54:54.298090+0000","last_clean":"2024-09-16T16:54:54.298090+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:54:54.298090+0000","last_undegraded":"2024-09-16T16:54:54.298090+0000","last_fullsized":"2024-09-16T16:54:54.298090+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"52'259","reported_seq":283,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.362454+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:54:54.362454+0000","last_peered":"2024-09-16T16:54:54.362454+0000","last_clean":"2024-09-16T16:54:54.362454+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:54:54.362454+0000","last_undegraded":"2024-09-16T16:54:54.362454+0000","last_fullsized":"2024-09-16T16:54:54.362454+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2121728,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":2072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"52'288","reported_seq":312,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.761052+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:54:53.761052+0000","last_peered":"2024-09-16T16:54:53.761052+0000","last_clean":"2024-09-16T16:54:53.761052+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:54:53.761052+0000","last_undegraded":"2024-09-16T16:54:53.761052+0000","last_fullsized":"2024-09-16T16:54:53.761052+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"52'232","reported_seq":256,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.388451+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:54:53.388451+0000","last_peered":"2024-09-16T16:54:53.388451+0000","last_clean":"2024-09-16T16:54:53.388451+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:54:53.388451+0000","last_undegraded":"2024-09-16T16:54:53.388451+0000","last_fullsized":"2024-09-16T16:54:53.388451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"52'248","reported_seq":272,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.202637+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:54:54.202637+0000","last_peered":"2024-09-16T16:54:54.202637+0000","last_clean":"2024-09-16T16:54:54.202637+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:54:54.202637+0000","last_undegraded":"2024-09-16T16:54:54.202637+0000","last_fullsized":"2024-09-16T16:54:54.202637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"52'184","reported_seq":208,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.930930+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:54:53.930930+0000","last_peered":"2024-09-16T16:54:53.930930+0000","last_clean":"2024-09-16T16:54:53.930930+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:54:53.930930+0000","last_undegraded":"2024-09-16T16:54:53.930930+0000","last_fullsized":"2024-09-16T16:54:53.930930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"52'272","reported_seq":296,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:53.715683+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:54:53.715683+0000","last_peered":"2024-09-16T16:54:53.715683+0000","last_clean":"2024-09-16T16:54:53.715683+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:54:53.715683+0000","last_undegraded":"2024-09-16T16:54:53.715683+0000","last_fullsized":"2024-09-16T16:54:53.715683+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"52'216","reported_seq":240,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:54.139674+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:54:54.139674+0000","last_peered":"2024-09-16T16:54:54.139674+0000","last_clean":"2024-09-16T16:54:54.139674+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:54:54.139674+0000","last_undegraded":"2024-09-16T16:54:54.139674+0000","last_fullsized":"2024-09-16T16:54:54.139674+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":29843456,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3643,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214019162112,"internally_reserved":0,"allocated":192331776,"data_stored":192331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214019162112,"internally_reserved":0,"allocated":192331776,"data_stored":192331776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":57368,"kb_used_data":57368,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52240360,"statfs":{"total":53552873472,"available":53494128640,"internally_reserved":0,"allocated":58744832,"data_stored":58744832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":35768,"kb_used_data":35768,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52261960,"statfs":{"total":53552873472,"available":53516247040,"internally_reserved":0,"allocated":36626432,"data_stored":36626432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":46940,"kb_used_data":46940,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52250788,"statfs":{"total":53552873472,"available":53504806912,"internally_reserved":0,"allocated":48066560,"data_stored":48066560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":43856,"kb_used_data":43856,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52253872,"statfs":{"total":53552873472,"available":53507964928,"internally_reserved":0,"allocated":44908544,"data_stored":44908544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53507227648,"internally_reserved":0,"allocated":45645824,"data_stored":45645824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53503922176,"internally_reserved":0,"allocated":48951296,"data_stored":48951296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53515341824,"internally_reserved":0,"allocated":37531648,"data_stored":37531648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53507227648,"internally_reserved":0,"allocated":45645824,"data_stored":45645824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53503922176,"internally_reserved":0,"allocated":48951296,"data_stored":48951296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53515341824,"internally_reserved":0,"allocated":37531648,"data_stored":37531648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53492670464,"internally_reserved":0,"allocated":60203008,"data_stored":60203008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:08.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 5144 5128 0.817525 0.820312 0.266293 0.152439 2024-09-16T16:55:08.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:08.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:08.884+0000 7fab184d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:08.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:08.891+0000 7fab184d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:09.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 5248 5232 0.817423 0.8125 0.33637 0.15257 2024-09-16T16:55:10.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5347 5331 0.816559 0.773438 0.202859 0.15271 2024-09-16T16:55:11.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 16 5471 5455 0.819484 0.96875 0.150816 0.15235 2024-09-16T16:55:11.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:11.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:11.427+0000 7f63f60bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:11.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:11.435+0000 7f63f60bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:12.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 5580 5564 0.820088 0.851562 0.165598 0.152043 2024-09-16T16:55:13.167 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:13.167 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:13.167 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:13.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:13.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 5677 5661 0.818934 0.757812 0.114137 0.152237 2024-09-16T16:55:13.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.306+0000 7f6ccbd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:13.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.319+0000 7f6ccbd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:13.395 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:13.396 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:13.396 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:13.396 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:13.400 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:13.400 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:13.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:13.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.589+0000 7f7c40711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:13.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.609+0000 7f7c40711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:13.635 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:13.636 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:13.640 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:13.641 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:13.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:13.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:13.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.765+0000 7f79f6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:13.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.778+0000 7f79f6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:13.877 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:13.878 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:13.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:13.882 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:13.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:13.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.879+0000 7f299a65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:13.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:13.889+0000 7f299a65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:14.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:14.040+0000 7f337c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:14.059+0000 7f337c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:14.215 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:14.216 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:14.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:14.221 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:14.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 5792 5776 0.820378 0.898438 0.185201 0.152083 2024-09-16T16:55:15.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 5893 5877 0.819817 0.789062 0.14046 0.152185 2024-09-16T16:55:16.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:16.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 6011 5995 0.821606 0.921875 0.192594 0.151874 2024-09-16T16:55:16.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:16.342+0000 7f3a458fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:16.350+0000 7f3a458fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:17.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 6128 6112 0.823198 0.914062 0.157872 0.151614 2024-09-16T16:55:18.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 6253 6237 0.825796 0.976562 0.0765518 0.151181 2024-09-16T16:55:18.710 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:18.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:18.831+0000 7f07c1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:18.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:18.838+0000 7f07c1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.222 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:19.222 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:19.222 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:19.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:19.270 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:55:19.271120+0000 min lat: 0.0207673 max lat: 0.791977 avg lat: 0.151177 2024-09-16T16:55:19.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:55:19.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 6358 6342 0.825703 0.820312 0.0919823 0.151177 2024-09-16T16:55:19.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:19.395+0000 7fa7870c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:19.410+0000 7fa7870c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:19.503 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:19.504 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:19.506 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:19.507 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:19.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:19.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:19.661+0000 7f54de06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:19.675+0000 7f54de06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:19.699 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:19.700 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:19.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:19.704 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:19.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:19.864+0000 7fca62d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:19.877+0000 7fca62d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:19.980 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:19.981 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:19.984 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:19.984 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:19.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:20.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:20.108+0000 7ffa0f908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:20.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:20.121+0000 7ffa0f908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:20.186 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:20.187 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:20.187 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:20.187 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:20.189 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:20.190 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:20.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 6468 6452 0.826254 0.859375 0.177105 0.151114 2024-09-16T16:55:21.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:21.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:21.223+0000 7fe0f8023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:21.232+0000 7fe0f8023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:21.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6560 6544 0.824519 0.71875 0.149442 0.151448 2024-09-16T16:55:22.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 6667 6651 0.824699 0.835938 0.104285 0.151365 2024-09-16T16:55:23.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 16 6775 6759 0.824995 0.84375 0.0637969 0.151304 2024-09-16T16:55:23.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:23.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:23.622+0000 7f6699d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:23.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:23.630+0000 7f6699d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:24.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 6869 6853 0.8236 0.734375 0.17188 0.15153 2024-09-16T16:55:25.190 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:25.190 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:25.191 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:25.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:25.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 6970 6954 0.823076 0.789062 0.225051 0.151673 2024-09-16T16:55:25.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.308+0000 7ff5102d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.322+0000 7ff5102d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:25.345 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:25.345 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:25.345 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:25.345 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:25.345 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:25.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:25.348 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:25.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:25.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.476+0000 7fb98f0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.487+0000 7fb98f0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:25.505 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:25.508 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:25.508 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:25.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:25.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.626+0000 7f4ef1efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.638+0000 7f4ef1efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:25.667 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:25.667 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:25.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:25.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.788+0000 7efe81b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:25.800+0000 7efe81b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:25.863 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:25.864 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:25.867 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:25.867 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:25.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:26.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:26.037+0000 7fd0f8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:26.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:26.045+0000 7fd0f8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:26.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 7059 7043 0.821167 0.695312 0.102736 0.151941 2024-09-16T16:55:27.271 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 7154 7138 0.820005 0.742188 0.0748667 0.15223 2024-09-16T16:55:28.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 16 7266 7250 0.820801 0.875 0.111587 0.152154 2024-09-16T16:55:28.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:28.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:28.495+0000 7f7f5a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:28.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:28.503+0000 7f7f5a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:29.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 7381 7365 0.821909 0.898438 0.228219 0.151878 2024-09-16T16:55:30.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 7499 7483 0.823315 0.921875 0.160866 0.151706 2024-09-16T16:55:30.868 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:30.869 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:30.869 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:30.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:30.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:31.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.017+0000 7ff852f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.031+0000 7ff852f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.101 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:31.101 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:31.101 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:31.102 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:31.105 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:31.105 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:31.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:31.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.110+0000 7f9318f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.118+0000 7f9318f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.249+0000 7fbe09288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.261+0000 7fbe09288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7578 7562 0.820452 0.617188 0.413045 0.151884 2024-09-16T16:55:31.381 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:31.381 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:31.381 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:31.382 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:31.383 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:31.385 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:31.386 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:31.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.571+0000 7f473ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.588+0000 7f473ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.616 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:31.616 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:31.616 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:31.616 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:31.617 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:31.621 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:31.621 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:31.622 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.769+0000 7f1c95d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:31.781+0000 7f1c95d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:31.940 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:31.944 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:31.944 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:32.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 7676 7660 0.8197 0.765625 0.0985077 0.152361 2024-09-16T16:55:33.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 7764 7748 0.817913 0.6875 0.107416 0.152533 2024-09-16T16:55:33.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:33.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:33.526+0000 7f1263111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:33.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:33.533+0000 7f1263111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:34.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 7877 7861 0.818777 0.882812 0.113389 0.152493 2024-09-16T16:55:35.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 7978 7962 0.818385 0.789062 0.135708 0.152466 2024-09-16T16:55:35.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:35.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:35.987+0000 7fb4bf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:35.996+0000 7fb4bf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:36.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 8076 8060 0.817698 0.765625 0.162814 0.152725 2024-09-16T16:55:36.945 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:36.945 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:36.945 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:36.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.106+0000 7fba5c908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.123+0000 7fba5c908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:37.212 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:37.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:37.216 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:37.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:37.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 8182 8166 0.817831 0.828125 0.111495 0.152683 2024-09-16T16:55:37.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.339+0000 7f754a0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.351+0000 7f754a0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:37.373 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:37.373 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:37.373 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:37.373 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:37.373 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:37.373 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:37.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:37.376 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:37.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:37.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.501+0000 7f932a351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.514+0000 7f932a351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:37.578 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:37.583 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:37.583 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:37.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:37.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.772+0000 7f0e908bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:37.789+0000 7f0e908bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:37.901 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:37.902 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:37.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:37.905 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:38.272 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 8288 8272 0.81796 0.828125 0.239761 0.15257 2024-09-16T16:55:38.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:38.494+0000 7feac7cf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:38.502+0000 7feac7cf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:39.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:55:39.273034+0000 min lat: 0.0207673 max lat: 0.791977 avg lat: 0.152974 2024-09-16T16:55:39.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:55:39.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 8374 8358 0.816134 0.671875 0.0837204 0.152974 2024-09-16T16:55:40.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 8475 8459 0.815798 0.789062 0.122375 0.153003 2024-09-16T16:55:40.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:40.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:40.901+0000 7ffaecd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:40.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:40.909+0000 7ffaecd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:41.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 16 8582 8566 0.816043 0.835938 0.140706 0.153006 2024-09-16T16:55:42.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 8691 8675 0.81647 0.851562 0.0700214 0.152954 2024-09-16T16:55:42.907 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:42.907 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:42.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:55:43.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:43.035+0000 7f3d08d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:43.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:43.048+0000 7f3d08d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:43.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:43.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 8782 8766 0.815213 0.710938 0.112564 0.153183 2024-09-16T16:55:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:43.368+0000 7f3111e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:43.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:43.375+0000 7f3111e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:43.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:55:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:55:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-16T16:55:42.466102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":56943155,"num_objects":864,"num_object_clones":0,"num_object_copies":2592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6960,"num_write_kb":56140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6934,"ondisk_log_size":6934,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":346160,"kb_used_data":346160,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208844752,"statfs":{"total":214211493888,"available":213857026048,"internally_reserved":0,"allocated":354467840,"data_stored":354467840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002220"},"pg_stats":[{"pgid":"7.f","version":"52'464","reported_seq":488,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:22.379749+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:55:22.379749+0000","last_peered":"2024-09-16T16:55:22.379749+0000","last_clean":"2024-09-16T16:55:22.379749+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:55:22.379749+0000","last_undegraded":"2024-09-16T16:55:22.379749+0000","last_fullsized":"2024-09-16T16:55:22.379749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"52'448","reported_seq":472,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:24.225971+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:55:24.225971+0000","last_peered":"2024-09-16T16:55:24.225971+0000","last_clean":"2024-09-16T16:55:24.225971+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:55:24.225971+0000","last_undegraded":"2024-09-16T16:55:24.225971+0000","last_fullsized":"2024-09-16T16:55:24.225971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"52'352","reported_seq":376,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.355953+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:55:23.355953+0000","last_peered":"2024-09-16T16:55:23.355953+0000","last_clean":"2024-09-16T16:55:23.355953+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:55:23.355953+0000","last_undegraded":"2024-09-16T16:55:23.355953+0000","last_fullsized":"2024-09-16T16:55:23.355953+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"52'424","reported_seq":448,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.220643+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:55:23.220643+0000","last_peered":"2024-09-16T16:55:23.220643+0000","last_clean":"2024-09-16T16:55:23.220643+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:55:23.220643+0000","last_undegraded":"2024-09-16T16:55:23.220643+0000","last_fullsized":"2024-09-16T16:55:23.220643+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"52'368","reported_seq":392,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:24.072746+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:55:24.072746+0000","last_peered":"2024-09-16T16:55:24.072746+0000","last_clean":"2024-09-16T16:55:24.072746+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:55:24.072746+0000","last_undegraded":"2024-09-16T16:55:24.072746+0000","last_fullsized":"2024-09-16T16:55:24.072746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"52'416","reported_seq":440,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.821949+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:55:23.821949+0000","last_peered":"2024-09-16T16:55:23.821949+0000","last_clean":"2024-09-16T16:55:23.821949+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:55:23.821949+0000","last_undegraded":"2024-09-16T16:55:23.821949+0000","last_fullsized":"2024-09-16T16:55:23.821949+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"52'432","reported_seq":456,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:22.673562+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:55:22.673562+0000","last_peered":"2024-09-16T16:55:22.673562+0000","last_clean":"2024-09-16T16:55:22.673562+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:55:22.673562+0000","last_undegraded":"2024-09-16T16:55:22.673562+0000","last_fullsized":"2024-09-16T16:55:22.673562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"52'424","reported_seq":448,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.999599+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:55:23.999599+0000","last_peered":"2024-09-16T16:55:23.999599+0000","last_clean":"2024-09-16T16:55:23.999599+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:55:23.999599+0000","last_undegraded":"2024-09-16T16:55:23.999599+0000","last_fullsized":"2024-09-16T16:55:23.999599+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"52'352","reported_seq":376,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.701054+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:55:23.701054+0000","last_peered":"2024-09-16T16:55:23.701054+0000","last_clean":"2024-09-16T16:55:23.701054+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:55:23.701054+0000","last_undegraded":"2024-09-16T16:55:23.701054+0000","last_fullsized":"2024-09-16T16:55:23.701054+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"52'487","reported_seq":511,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:24.382348+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:55:24.382348+0000","last_peered":"2024-09-16T16:55:24.382348+0000","last_clean":"2024-09-16T16:55:24.382348+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:55:24.382348+0000","last_undegraded":"2024-09-16T16:55:24.382348+0000","last_fullsized":"2024-09-16T16:55:24.382348+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3989504,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":3896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"52'456","reported_seq":480,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.445231+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:55:23.445231+0000","last_peered":"2024-09-16T16:55:23.445231+0000","last_clean":"2024-09-16T16:55:23.445231+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:55:23.445231+0000","last_undegraded":"2024-09-16T16:55:23.445231+0000","last_fullsized":"2024-09-16T16:55:23.445231+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"52'536","reported_seq":560,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.937065+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:55:23.937065+0000","last_peered":"2024-09-16T16:55:23.937065+0000","last_clean":"2024-09-16T16:55:23.937065+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:55:23.937065+0000","last_undegraded":"2024-09-16T16:55:23.937065+0000","last_fullsized":"2024-09-16T16:55:23.937065+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"52'488","reported_seq":512,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:22.105982+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:55:22.105982+0000","last_peered":"2024-09-16T16:55:22.105982+0000","last_clean":"2024-09-16T16:55:22.105982+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:55:22.105982+0000","last_undegraded":"2024-09-16T16:55:22.105982+0000","last_fullsized":"2024-09-16T16:55:22.105982+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"52'424","reported_seq":448,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:24.306355+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:55:24.306355+0000","last_peered":"2024-09-16T16:55:24.306355+0000","last_clean":"2024-09-16T16:55:24.306355+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:55:24.306355+0000","last_undegraded":"2024-09-16T16:55:24.306355+0000","last_fullsized":"2024-09-16T16:55:24.306355+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"52'432","reported_seq":456,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:22.459459+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:55:22.459459+0000","last_peered":"2024-09-16T16:55:22.459459+0000","last_clean":"2024-09-16T16:55:22.459459+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:55:22.459459+0000","last_undegraded":"2024-09-16T16:55:22.459459+0000","last_fullsized":"2024-09-16T16:55:22.459459+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"52'376","reported_seq":400,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:23.300876+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:55:23.300876+0000","last_peered":"2024-09-16T16:55:23.300876+0000","last_clean":"2024-09-16T16:55:23.300876+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:55:23.300876+0000","last_undegraded":"2024-09-16T16:55:23.300876+0000","last_fullsized":"2024-09-16T16:55:23.300876+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":56352768,"num_objects":860,"num_object_clones":0,"num_object_copies":2580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6879,"num_write_kb":55032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213853564928,"internally_reserved":0,"allocated":357928960,"data_stored":357928960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6879,"ondisk_log_size":6879,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213853573120,"internally_reserved":0,"allocated":357920768,"data_stored":357920768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53441802240,"internally_reserved":0,"allocated":111071232,"data_stored":111071232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":107228,"kb_used_data":107228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52190500,"statfs":{"total":53552873472,"available":53443072000,"internally_reserved":0,"allocated":109801472,"data_stored":109801472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65752,"kb_used_data":65752,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231976,"statfs":{"total":53552873472,"available":53485543424,"internally_reserved":0,"allocated":67330048,"data_stored":67330048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":92612,"kb_used_data":92612,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205116,"statfs":{"total":53552873472,"available":53458038784,"internally_reserved":0,"allocated":94834688,"data_stored":94834688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":80568,"kb_used_data":80568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52217160,"statfs":{"total":53552873472,"available":53470371840,"internally_reserved":0,"allocated":82501632,"data_stored":82501632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53441802240,"internally_reserved":0,"allocated":111071232,"data_stored":111071232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53469761536,"internally_reserved":0,"allocated":83111936,"data_stored":83111936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53457002496,"internally_reserved":0,"allocated":95870976,"data_stored":95870976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53485006848,"internally_reserved":0,"allocated":67866624,"data_stored":67866624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53441802240,"internally_reserved":0,"allocated":111071232,"data_stored":111071232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53469761536,"internally_reserved":0,"allocated":83111936,"data_stored":83111936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53456994304,"internally_reserved":0,"allocated":95879168,"data_stored":95879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53485006848,"internally_reserved":0,"allocated":67866624,"data_stored":67866624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53441802240,"internally_reserved":0,"allocated":111071232,"data_stored":111071232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:55:44.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 8867 8851 0.813434 0.664062 0.306309 0.153537 2024-09-16T16:55:45.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 8961 8945 0.812514 0.734375 0.191263 0.153692 2024-09-16T16:55:45.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:45.738+0000 7fa314b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:45.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:45.747+0000 7fa314b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:46.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 9062 9046 0.812243 0.789062 0.042863 0.153692 2024-09-16T16:55:47.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 16 9157 9141 0.811446 0.742188 0.257724 0.153897 2024-09-16T16:55:48.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:48.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.208+0000 7f58f1a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.216+0000 7f58f1a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.273 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 9262 9246 0.811545 0.820312 0.13641 0.153856 2024-09-16T16:55:48.405 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:48.406 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:48.406 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:48.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:48.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.535+0000 7f6223b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.550+0000 7f6223b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.574 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:48.574 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:48.574 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:48.574 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:48.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:48.578 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:48.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:48.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.706+0000 7fd832d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.718+0000 7fd832d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:48.742 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:48.743 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:48.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:48.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.866+0000 7f374eebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:48.879+0000 7f374eebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:48.915 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:48.915 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:48.916 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:48.920 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:48.921 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:48.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:49.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:49.043+0000 7fb6a9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:49.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:49.053+0000 7fb6a9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:49.077 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:49.077 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:49.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 15 9339 9324 0.809298 0.609375 0.240921 0.154271 2024-09-16T16:55:50.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.1139 2024-09-16T16:55:50.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 9339 2024-09-16T16:55:50.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T16:55:50.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T16:55:50.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.809652 2024-09-16T16:55:50.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.0939823 2024-09-16T16:55:50.274 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 1.07031 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.609375 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 103 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 12.0297 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 137 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 78 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.154281 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.0840842 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 0.791977 2024-09-16T16:55:50.275 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0207673 2024-09-16T16:55:50.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:55:50.458 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:50.637+0000 7feb834f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:50.647+0000 7feb834f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:52.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:53.124+0000 7f15ddf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:53.132+0000 7f15ddf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.078 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:55:54.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:55:54.078 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:55:54.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:55:54.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.215+0000 7f2d4b911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.233+0000 7f2d4b911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:54.273 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:54.274 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:54.274 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:54.274 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:54.275 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:54.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:55:54.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.418+0000 7f9c4ee88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.431+0000 7f9c4ee88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:54.460 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:54.461 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:54.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:55:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.614+0000 7fa603748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.627+0000 7fa603748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:54.758 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:54.762 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:54.762 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:54.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:55:54.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.924+0000 7f32beb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:54.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:54.941+0000 7f32beb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:55.061 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:55:55.061 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:55:55.061 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:55:55.062 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:55:55.065 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:55:55.065 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:55:55.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:55:55.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:55.616+0000 7fdb3fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:55.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:55.628+0000 7fdb3fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:57.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:55:58.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:58.144+0000 7f9783b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:55:58.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:55:58.154+0000 7f9783b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:00.066 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:00.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:00.066 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:00.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:00.196+0000 7f9b16c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:00.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:00.206+0000 7f9b16c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:00.477 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:00.478 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:00.493 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-16T16:56:00.469714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":48456267,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9858,"num_write_kb":75821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9832,"ondisk_log_size":9832,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8486888,"num_objects":-128,"num_object_clones":0,"num_object_copies":-384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2898,"num_write_kb":19681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002410"},"pg_stats":[{"pgid":"7.f","version":"52'683","reported_seq":707,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.326845+0000","last_change":"2024-09-16T16:54:18.422117+0000","last_active":"2024-09-16T16:55:54.326845+0000","last_peered":"2024-09-16T16:55:54.326845+0000","last_clean":"2024-09-16T16:55:54.326845+0000","last_became_active":"2024-09-16T16:54:18.413604+0000","last_became_peered":"2024-09-16T16:54:18.413604+0000","last_unstale":"2024-09-16T16:55:54.326845+0000","last_undegraded":"2024-09-16T16:55:54.326845+0000","last_fullsized":"2024-09-16T16:55:54.326845+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"52'631","reported_seq":655,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:53.981686+0000","last_change":"2024-09-16T16:54:18.348363+0000","last_active":"2024-09-16T16:55:53.981686+0000","last_peered":"2024-09-16T16:55:53.981686+0000","last_clean":"2024-09-16T16:55:53.981686+0000","last_became_active":"2024-09-16T16:54:18.335287+0000","last_became_peered":"2024-09-16T16:54:18.335287+0000","last_unstale":"2024-09-16T16:55:53.981686+0000","last_undegraded":"2024-09-16T16:55:53.981686+0000","last_fullsized":"2024-09-16T16:55:53.981686+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"52'506","reported_seq":531,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:53.845354+0000","last_change":"2024-09-16T16:54:18.368047+0000","last_active":"2024-09-16T16:55:53.845354+0000","last_peered":"2024-09-16T16:55:53.845354+0000","last_clean":"2024-09-16T16:55:53.845354+0000","last_became_active":"2024-09-16T16:54:18.353836+0000","last_became_peered":"2024-09-16T16:54:18.353836+0000","last_unstale":"2024-09-16T16:55:53.845354+0000","last_undegraded":"2024-09-16T16:55:53.845354+0000","last_fullsized":"2024-09-16T16:55:53.845354+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293784,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":506,"num_write_kb":3841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"52'588","reported_seq":612,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.102530+0000","last_change":"2024-09-16T16:54:18.416628+0000","last_active":"2024-09-16T16:55:54.102530+0000","last_peered":"2024-09-16T16:55:54.102530+0000","last_clean":"2024-09-16T16:55:54.102530+0000","last_became_active":"2024-09-16T16:54:18.410508+0000","last_became_peered":"2024-09-16T16:54:18.410508+0000","last_unstale":"2024-09-16T16:55:54.102530+0000","last_undegraded":"2024-09-16T16:55:54.102530+0000","last_fullsized":"2024-09-16T16:55:54.102530+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":588,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"52'518","reported_seq":542,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.262362+0000","last_change":"2024-09-16T16:54:18.379022+0000","last_active":"2024-09-16T16:55:54.262362+0000","last_peered":"2024-09-16T16:55:54.262362+0000","last_clean":"2024-09-16T16:55:54.262362+0000","last_became_active":"2024-09-16T16:54:18.362937+0000","last_became_peered":"2024-09-16T16:54:18.362937+0000","last_unstale":"2024-09-16T16:55:54.262362+0000","last_undegraded":"2024-09-16T16:55:54.262362+0000","last_fullsized":"2024-09-16T16:55:54.262362+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":518,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"52'590","reported_seq":614,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:53.864528+0000","last_change":"2024-09-16T16:54:18.338263+0000","last_active":"2024-09-16T16:55:53.864528+0000","last_peered":"2024-09-16T16:55:53.864528+0000","last_clean":"2024-09-16T16:55:53.864528+0000","last_became_active":"2024-09-16T16:54:18.319264+0000","last_became_peered":"2024-09-16T16:54:18.319264+0000","last_unstale":"2024-09-16T16:55:53.864528+0000","last_undegraded":"2024-09-16T16:55:53.864528+0000","last_fullsized":"2024-09-16T16:55:53.864528+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"52'608","reported_seq":632,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.141103+0000","last_change":"2024-09-16T16:54:18.522270+0000","last_active":"2024-09-16T16:55:54.141103+0000","last_peered":"2024-09-16T16:55:54.141103+0000","last_clean":"2024-09-16T16:55:54.141103+0000","last_became_active":"2024-09-16T16:54:18.516379+0000","last_became_peered":"2024-09-16T16:54:18.516379+0000","last_unstale":"2024-09-16T16:55:54.141103+0000","last_undegraded":"2024-09-16T16:55:54.141103+0000","last_fullsized":"2024-09-16T16:55:54.141103+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842624,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"52'657","reported_seq":681,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:53.975490+0000","last_change":"2024-09-16T16:54:18.335369+0000","last_active":"2024-09-16T16:55:53.975490+0000","last_peered":"2024-09-16T16:55:53.975490+0000","last_clean":"2024-09-16T16:55:53.975490+0000","last_became_active":"2024-09-16T16:54:18.325979+0000","last_became_peered":"2024-09-16T16:54:18.325979+0000","last_unstale":"2024-09-16T16:55:53.975490+0000","last_undegraded":"2024-09-16T16:55:53.975490+0000","last_fullsized":"2024-09-16T16:55:53.975490+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"52'552","reported_seq":576,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:53.964298+0000","last_change":"2024-09-16T16:54:18.458806+0000","last_active":"2024-09-16T16:55:53.964298+0000","last_peered":"2024-09-16T16:55:53.964298+0000","last_clean":"2024-09-16T16:55:53.964298+0000","last_became_active":"2024-09-16T16:54:18.450770+0000","last_became_peered":"2024-09-16T16:54:18.450770+0000","last_unstale":"2024-09-16T16:55:53.964298+0000","last_undegraded":"2024-09-16T16:55:53.964298+0000","last_fullsized":"2024-09-16T16:55:53.964298+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"52'687","reported_seq":711,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.176384+0000","last_change":"2024-09-16T16:54:18.403036+0000","last_active":"2024-09-16T16:55:54.176384+0000","last_peered":"2024-09-16T16:55:54.176384+0000","last_clean":"2024-09-16T16:55:54.176384+0000","last_became_active":"2024-09-16T16:54:18.395714+0000","last_became_peered":"2024-09-16T16:54:18.395714+0000","last_unstale":"2024-09-16T16:55:54.176384+0000","last_undegraded":"2024-09-16T16:55:54.176384+0000","last_fullsized":"2024-09-16T16:55:54.176384+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"52'683","reported_seq":707,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.058306+0000","last_change":"2024-09-16T16:54:18.462052+0000","last_active":"2024-09-16T16:55:54.058306+0000","last_peered":"2024-09-16T16:55:54.058306+0000","last_clean":"2024-09-16T16:55:54.058306+0000","last_became_active":"2024-09-16T16:54:18.455899+0000","last_became_peered":"2024-09-16T16:54:18.455899+0000","last_unstale":"2024-09-16T16:55:54.058306+0000","last_undegraded":"2024-09-16T16:55:54.058306+0000","last_fullsized":"2024-09-16T16:55:54.058306+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"52'692","reported_seq":716,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:53.663175+0000","last_change":"2024-09-16T16:54:18.367778+0000","last_active":"2024-09-16T16:55:53.663175+0000","last_peered":"2024-09-16T16:55:53.663175+0000","last_clean":"2024-09-16T16:55:53.663175+0000","last_became_active":"2024-09-16T16:54:18.347664+0000","last_became_peered":"2024-09-16T16:54:18.347664+0000","last_unstale":"2024-09-16T16:55:53.663175+0000","last_undegraded":"2024-09-16T16:55:53.663175+0000","last_fullsized":"2024-09-16T16:55:53.663175+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":692,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"52'654","reported_seq":678,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.061463+0000","last_change":"2024-09-16T16:54:18.338308+0000","last_active":"2024-09-16T16:55:54.061463+0000","last_peered":"2024-09-16T16:55:54.061463+0000","last_clean":"2024-09-16T16:55:54.061463+0000","last_became_active":"2024-09-16T16:54:18.327958+0000","last_became_peered":"2024-09-16T16:54:18.327958+0000","last_unstale":"2024-09-16T16:55:54.061463+0000","last_undegraded":"2024-09-16T16:55:54.061463+0000","last_fullsized":"2024-09-16T16:55:54.061463+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"52'590","reported_seq":614,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.278107+0000","last_change":"2024-09-16T16:54:18.328037+0000","last_active":"2024-09-16T16:55:54.278107+0000","last_peered":"2024-09-16T16:55:54.278107+0000","last_clean":"2024-09-16T16:55:54.278107+0000","last_became_active":"2024-09-16T16:54:18.315299+0000","last_became_peered":"2024-09-16T16:54:18.315299+0000","last_unstale":"2024-09-16T16:55:54.278107+0000","last_undegraded":"2024-09-16T16:55:54.278107+0000","last_fullsized":"2024-09-16T16:55:54.278107+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"52'600","reported_seq":624,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:54.096654+0000","last_change":"2024-09-16T16:54:18.334917+0000","last_active":"2024-09-16T16:55:54.096654+0000","last_peered":"2024-09-16T16:55:54.096654+0000","last_clean":"2024-09-16T16:55:54.096654+0000","last_became_active":"2024-09-16T16:54:18.287270+0000","last_became_peered":"2024-09-16T16:54:18.287270+0000","last_unstale":"2024-09-16T16:55:54.096654+0000","last_undegraded":"2024-09-16T16:55:54.096654+0000","last_fullsized":"2024-09-16T16:55:54.096654+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"52'538","reported_seq":562,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:55:53.703619+0000","last_change":"2024-09-16T16:54:18.487903+0000","last_active":"2024-09-16T16:55:53.703619+0000","last_peered":"2024-09-16T16:55:53.703619+0000","last_clean":"2024-09-16T16:55:53.703619+0000","last_became_active":"2024-09-16T16:54:18.481847+0000","last_became_peered":"2024-09-16T16:54:18.481847+0000","last_unstale":"2024-09-16T16:55:53.703619+0000","last_undegraded":"2024-09-16T16:55:53.703619+0000","last_fullsized":"2024-09-16T16:55:53.703619+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:54:17.164026+0000","last_clean_scrub_stamp":"2024-09-16T16:54:17.164026+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":47865880,"num_objects":732,"num_object_clones":0,"num_object_copies":2196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9777,"num_write_kb":74713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9777,"ondisk_log_size":9777,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:00.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:00.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:00.767+0000 7f8d3fa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:00.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:00.776+0000 7f8d3fa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:01.869 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1168 objects 2024-09-16T16:56:01.869 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :11.5566 2024-09-16T16:56:02.917 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-16T16:56:02.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-16T16:56:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:03.029+0000 7fe52ac97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:03.043+0000 7fe52ac97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:03.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:03.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:03.256+0000 7f8a7c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:03.262+0000 7f8a7c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_4' removed 2024-09-16T16:56:04.211 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:56:04.211 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:56:04.212 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_5 2024-09-16T16:56:04.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_5 16 2024-09-16T16:56:04.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:04.363+0000 7f7e5e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:04.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:04.385+0000 7f7e5e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:05.195 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_5' created 2024-09-16T16:56:05.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2024-09-16T16:56:05.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:05.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:05.366+0000 7f9be7e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:05.385+0000 7f9be7e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:05.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:05.487+0000 7f193e6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:05.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:05.494+0000 7f193e6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:05.495 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:05.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:56:05.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:05.613+0000 7f5327c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:05.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:05.624+0000 7f5327c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:06.199 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_5' 2024-09-16T16:56:06.200 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:56:06.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:56:06.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:06.440+0000 7f41de04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:06.459+0000 7f41de04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:07.203 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:56:07.220 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_5 bench 90 write' 2024-09-16T16:56:07.222 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:56:07.223 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:56:07.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:56:07.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:56:07.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:56:07.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_51780 2024-09-16T16:56:07.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:56:07.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:56:07.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:07.430+0000 7fdb25f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:07.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:07.444+0000 7fdb25f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:07.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:07.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:07.726+0000 7f3a0cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:07.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:07.732+0000 7f3a0cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:56:08.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:56:08.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 103 87 0.679641 0.679688 0.244602 0.166881 2024-09-16T16:56:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:08.395+0000 7fee5f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:08.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:08.408+0000 7fee5f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:56:09.237 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:56:09.237 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:09.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 198 182 0.71088 0.742188 0.172566 0.168164 2024-09-16T16:56:09.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:09.402+0000 7f6d5d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:09.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:09.413+0000 7f6d5d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:09.734 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:09.749 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-16T16:56:09.213226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016948"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:09.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:09.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:09.871+0000 7f29f0aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:09.882+0000 7f29f0aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:09.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:10.106 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:10.123 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-16T16:56:09.213226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016948"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:10.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:56:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:10.141+0000 7ff1cc4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:10.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:10.150+0000 7ff1cc4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:10.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:10.290+0000 7f2d5bc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:10.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 282 266 0.69265 0.65625 0.269316 0.171078 2024-09-16T16:56:10.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:10.299+0000 7f2d5bc74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:10.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:10.704 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":563,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":58,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":339496960,"bytes_avail":213871996928,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:56:10.723 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:56:10.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:10.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:10.859+0000 7f98c8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:10.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:10.871+0000 7f98c8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:11.106 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-16T16:56:10.471608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.271465"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:11.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 16 412 396 0.773371 1.01562 0.148578 0.159295 2024-09-16T16:56:12.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 514 498 0.778055 0.796875 0.233054 0.157899 2024-09-16T16:56:12.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:12.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:12.667+0000 7f6d3ab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:12.675+0000 7f6d3ab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:13.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 623 607 0.79029 0.851562 0.177557 0.150953 2024-09-16T16:56:14.108 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:14.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:14.276+0000 7ff462d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:14.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:14.288+0000 7ff462d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:14.299 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 714 698 0.778945 0.710938 0.121156 0.158338 2024-09-16T16:56:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:14.677 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:14.697 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-16T16:56:14.472287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.268750"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:14.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:56:14.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:14.822+0000 7f9fd2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:14.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:14.831+0000 7f9fd2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:14.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:15.112+0000 7f3a69951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:15.119+0000 7f3a69951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:15.146 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:15.146 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":568,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":58,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":339496960,"bytes_avail":213871996928,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:56:15.170 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:56:15.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:15.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 777 761 0.743095 0.492188 0.202645 0.16664 2024-09-16T16:56:15.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:15.327+0000 7f0471351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:15.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:15.339+0000 7f0471351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:15.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:15.632 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:15.656 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-16T16:56:14.472287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.268750"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:16.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 886 870 0.755138 0.851562 0.102458 0.164039 2024-09-16T16:56:17.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 994 978 0.763992 0.84375 0.0349484 0.159896 2024-09-16T16:56:17.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:17.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:17.545+0000 7f0babd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:17.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:17.553+0000 7f0babd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1107 1091 0.774786 0.882812 0.0540582 0.160453 2024-09-16T16:56:18.659 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:18.798+0000 7fef65f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:18.811+0000 7fef65f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:19.111 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:19.111 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:19.126 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-16T16:56:18.472894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001594"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:19.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:56:19.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1210 1194 0.777271 0.804688 0.0949138 0.159715 2024-09-16T16:56:19.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:19.301+0000 7f219cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:19.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:19.314+0000 7f219cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:19.849 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":572,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":58,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":339496960,"bytes_avail":213871996928,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:56:19.876 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:56:19.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:19.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:20.000+0000 7f7e8e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:20.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:20.010+0000 7f7e8e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:20.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:20.062+0000 7f1180791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:20.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:20.071+0000 7f1180791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:20.296 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:20.297 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:20.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1318 1302 0.782379 0.84375 0.078379 0.158355 2024-09-16T16:56:20.312 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-16T16:56:18.472894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001594"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:21.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1433 1417 0.790662 0.898438 0.0929027 0.156723 2024-09-16T16:56:22.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1554 1538 0.800966 0.945312 0.0971252 0.155349 2024-09-16T16:56:22.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:22.437+0000 7f5d026a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:22.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:22.445+0000 7f5d026a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:23.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1638 1622 0.791918 0.65625 0.134093 0.156913 2024-09-16T16:56:23.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:23.435+0000 7f8321d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:23.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:23.445+0000 7f8321d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:23.670 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:23.671 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-16T16:56:22.473495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":331540,"kb_used_data":331540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208859372,"statfs":{"total":214211493888,"available":213871996928,"internally_reserved":0,"allocated":339496960,"data_stored":339496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001887"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":196,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.253693+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:54:27.253693+0000","last_peered":"2024-09-16T16:54:27.253693+0000","last_clean":"2024-09-16T16:54:27.253693+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:54:27.253693+0000","last_undegraded":"2024-09-16T16:54:27.253693+0000","last_fullsized":"2024-09-16T16:54:27.253693+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.238901+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:54:27.238901+0000","last_peered":"2024-09-16T16:54:27.238901+0000","last_clean":"2024-09-16T16:54:27.238901+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:54:27.238901+0000","last_undegraded":"2024-09-16T16:54:27.238901+0000","last_fullsized":"2024-09-16T16:54:27.238901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.266979+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:54:27.266979+0000","last_peered":"2024-09-16T16:54:27.266979+0000","last_clean":"2024-09-16T16:54:27.266979+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:54:27.266979+0000","last_undegraded":"2024-09-16T16:54:27.266979+0000","last_fullsized":"2024-09-16T16:54:27.266979+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.233296+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:54:27.233296+0000","last_peered":"2024-09-16T16:54:27.233296+0000","last_clean":"2024-09-16T16:54:27.233296+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:54:27.233296+0000","last_undegraded":"2024-09-16T16:54:27.233296+0000","last_fullsized":"2024-09-16T16:54:27.233296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":123,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.261057+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:54:27.261057+0000","last_peered":"2024-09-16T16:54:27.261057+0000","last_clean":"2024-09-16T16:54:27.261057+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:54:27.261057+0000","last_undegraded":"2024-09-16T16:54:27.261057+0000","last_fullsized":"2024-09-16T16:54:27.261057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.235864+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:54:27.235864+0000","last_peered":"2024-09-16T16:54:27.235864+0000","last_clean":"2024-09-16T16:54:27.235864+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:54:27.235864+0000","last_undegraded":"2024-09-16T16:54:27.235864+0000","last_fullsized":"2024-09-16T16:54:27.235864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.258321+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:54:27.258321+0000","last_peered":"2024-09-16T16:54:27.258321+0000","last_clean":"2024-09-16T16:54:27.258321+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:54:27.258321+0000","last_undegraded":"2024-09-16T16:54:27.258321+0000","last_fullsized":"2024-09-16T16:54:27.258321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.234785+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:54:27.234785+0000","last_peered":"2024-09-16T16:54:27.234785+0000","last_clean":"2024-09-16T16:54:27.234785+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:54:27.234785+0000","last_undegraded":"2024-09-16T16:54:27.234785+0000","last_fullsized":"2024-09-16T16:54:27.234785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:56:05.191744+0000","last_change":"2024-09-16T16:56:05.191744+0000","last_active":"2024-09-16T16:56:05.191744+0000","last_peered":"2024-09-16T16:56:05.191744+0000","last_clean":"2024-09-16T16:56:05.191744+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:56:05.191744+0000","last_undegraded":"2024-09-16T16:56:05.191744+0000","last_fullsized":"2024-09-16T16:56:05.191744+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-16T16:54:27.239071+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:54:27.239071+0000","last_peered":"2024-09-16T16:54:27.239071+0000","last_clean":"2024-09-16T16:54:27.239071+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:54:27.239071+0000","last_undegraded":"2024-09-16T16:54:27.239071+0000","last_fullsized":"2024-09-16T16:54:27.239071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213896617984,"internally_reserved":0,"allocated":314875904,"data_stored":314875904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":103844,"kb_used_data":103844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52193884,"statfs":{"total":53552873472,"available":53446537216,"internally_reserved":0,"allocated":106336256,"data_stored":106336256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61428,"kb_used_data":61428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236300,"statfs":{"total":53552873472,"available":53489971200,"internally_reserved":0,"allocated":62902272,"data_stored":62902272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":91932,"kb_used_data":91932,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52205796,"statfs":{"total":53552873472,"available":53458735104,"internally_reserved":0,"allocated":94138368,"data_stored":94138368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":74336,"kb_used_data":74336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52223392,"statfs":{"total":53552873472,"available":53476753408,"internally_reserved":0,"allocated":76120064,"data_stored":76120064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481054208,"internally_reserved":0,"allocated":71819264,"data_stored":71819264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53466787840,"internally_reserved":0,"allocated":86085632,"data_stored":86085632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53493874688,"internally_reserved":0,"allocated":58998784,"data_stored":58998784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53454901248,"internally_reserved":0,"allocated":97972224,"data_stored":97972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:23.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T16:56:23.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:23.805+0000 7f23eda46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:23.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:23.814+0000 7f23eda46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.155 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:24.155 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":577,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":58,"num_osds":4,"num_up_osds":4,"osd_up_since":1726505214,"num_in_osds":4,"osd_in_since":1726505209,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":339496960,"bytes_avail":213871996928,"bytes_total":214211493888,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T16:46:47:048453+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T16:47:54.375436+0000","services":{}},"progress_events":{}} 2024-09-16T16:56:24.172 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T16:56:24.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:24.300 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1729 1713 0.787151 0.710938 0.208352 0.15758 2024-09-16T16:56:24.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:24.322+0000 7f7b45591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:24.334+0000 7f7b45591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.575 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:24.592 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-16T16:56:24.473862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14787123,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1814,"num_write_kb":14972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":90832,"kb_used_data":90832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209100080,"statfs":{"total":214211493888,"available":214118481920,"internally_reserved":0,"allocated":93011968,"data_stored":93011968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001905"},"pg_stats":[{"pgid":"8.7","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.154936+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:23.154936+0000","last_peered":"2024-09-16T16:56:23.154936+0000","last_clean":"2024-09-16T16:56:23.154936+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:23.154936+0000","last_undegraded":"2024-09-16T16:56:23.154936+0000","last_fullsized":"2024-09-16T16:56:23.154936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'56","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.069328+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:24.069328+0000","last_peered":"2024-09-16T16:56:24.069328+0000","last_clean":"2024-09-16T16:56:24.069328+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:24.069328+0000","last_undegraded":"2024-09-16T16:56:24.069328+0000","last_fullsized":"2024-09-16T16:56:24.069328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'48","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:16.873733+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:16.873733+0000","last_peered":"2024-09-16T16:56:16.873733+0000","last_clean":"2024-09-16T16:56:16.873733+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:16.873733+0000","last_undegraded":"2024-09-16T16:56:16.873733+0000","last_fullsized":"2024-09-16T16:56:16.873733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'136","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.784794+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:22.784794+0000","last_peered":"2024-09-16T16:56:22.784794+0000","last_clean":"2024-09-16T16:56:22.784794+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:22.784794+0000","last_undegraded":"2024-09-16T16:56:22.784794+0000","last_fullsized":"2024-09-16T16:56:22.784794+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'80","reported_seq":98,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.153924+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:24.153924+0000","last_peered":"2024-09-16T16:56:24.153924+0000","last_clean":"2024-09-16T16:56:24.153924+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:24.153924+0000","last_undegraded":"2024-09-16T16:56:24.153924+0000","last_fullsized":"2024-09-16T16:56:24.153924+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.447066+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:23.447066+0000","last_peered":"2024-09-16T16:56:23.447066+0000","last_clean":"2024-09-16T16:56:23.447066+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:23.447066+0000","last_undegraded":"2024-09-16T16:56:23.447066+0000","last_fullsized":"2024-09-16T16:56:23.447066+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'176","reported_seq":194,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.896468+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:23.896468+0000","last_peered":"2024-09-16T16:56:23.896468+0000","last_clean":"2024-09-16T16:56:23.896468+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:23.896468+0000","last_undegraded":"2024-09-16T16:56:23.896468+0000","last_fullsized":"2024-09-16T16:56:23.896468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.257344+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:24.257344+0000","last_peered":"2024-09-16T16:56:24.257344+0000","last_clean":"2024-09-16T16:56:24.257344+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:24.257344+0000","last_undegraded":"2024-09-16T16:56:24.257344+0000","last_fullsized":"2024-09-16T16:56:24.257344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.694413+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:23.694413+0000","last_peered":"2024-09-16T16:56:23.694413+0000","last_clean":"2024-09-16T16:56:23.694413+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:23.694413+0000","last_undegraded":"2024-09-16T16:56:23.694413+0000","last_fullsized":"2024-09-16T16:56:23.694413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'96","reported_seq":114,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.789124+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:23.789124+0000","last_peered":"2024-09-16T16:56:23.789124+0000","last_clean":"2024-09-16T16:56:23.789124+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:23.789124+0000","last_undegraded":"2024-09-16T16:56:23.789124+0000","last_fullsized":"2024-09-16T16:56:23.789124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.991102+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:23.991102+0000","last_peered":"2024-09-16T16:56:23.991102+0000","last_clean":"2024-09-16T16:56:23.991102+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:23.991102+0000","last_undegraded":"2024-09-16T16:56:23.991102+0000","last_fullsized":"2024-09-16T16:56:23.991102+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.115378+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:22.115378+0000","last_peered":"2024-09-16T16:56:22.115378+0000","last_clean":"2024-09-16T16:56:22.115378+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:22.115378+0000","last_undegraded":"2024-09-16T16:56:22.115378+0000","last_fullsized":"2024-09-16T16:56:22.115378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'72","reported_seq":90,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:21.394121+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:21.394121+0000","last_peered":"2024-09-16T16:56:21.394121+0000","last_clean":"2024-09-16T16:56:21.394121+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:21.394121+0000","last_undegraded":"2024-09-16T16:56:21.394121+0000","last_fullsized":"2024-09-16T16:56:21.394121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.320014+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:23.320014+0000","last_peered":"2024-09-16T16:56:23.320014+0000","last_clean":"2024-09-16T16:56:23.320014+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:23.320014+0000","last_undegraded":"2024-09-16T16:56:23.320014+0000","last_fullsized":"2024-09-16T16:56:23.320014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'144","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.672800+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:22.672800+0000","last_peered":"2024-09-16T16:56:22.672800+0000","last_clean":"2024-09-16T16:56:22.672800+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:22.672800+0000","last_undegraded":"2024-09-16T16:56:22.672800+0000","last_fullsized":"2024-09-16T16:56:22.672800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'101","reported_seq":119,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.358385+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:24.358385+0000","last_peered":"2024-09-16T16:56:24.358385+0000","last_clean":"2024-09-16T16:56:24.358385+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:24.358385+0000","last_undegraded":"2024-09-16T16:56:24.358385+0000","last_fullsized":"2024-09-16T16:56:24.358385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":827392,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1733,"ondisk_log_size":1733,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24388,"kb_used_data":24388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273340,"statfs":{"total":53552873472,"available":53527900160,"internally_reserved":0,"allocated":24973312,"data_stored":24973312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17144,"kb_used_data":17144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52280584,"statfs":{"total":53552873472,"available":53535318016,"internally_reserved":0,"allocated":17555456,"data_stored":17555456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24984,"kb_used_data":24984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272744,"statfs":{"total":53552873472,"available":53527289856,"internally_reserved":0,"allocated":25583616,"data_stored":25583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24316,"kb_used_data":24316,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273412,"statfs":{"total":53552873472,"available":53527973888,"internally_reserved":0,"allocated":24899584,"data_stored":24899584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:24.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:24.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:24.896+0000 7f3d638d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:24.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:24.904+0000 7f3d638d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:25.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 1816 1800 0.781178 0.679688 0.120972 0.159562 2024-09-16T16:56:26.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 1933 1917 0.788167 0.914062 0.122562 0.157915 2024-09-16T16:56:27.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:27.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:27.282+0000 7f44900a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:27.290+0000 7f44900a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:27.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:56:27.301196+0000 min lat: 0.0225454 max lat: 0.607218 avg lat: 0.156737 2024-09-16T16:56:27.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:56:27.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2050 2034 0.794458 0.914062 0.204354 0.156737 2024-09-16T16:56:27.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:27.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:27.718+0000 7f4ca406c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:27.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:27.731+0000 7f4ca406c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:27.957 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:27.980 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-16T16:56:26.474415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14787123,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1814,"num_write_kb":14972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":90832,"kb_used_data":90832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209100080,"statfs":{"total":214211493888,"available":214118481920,"internally_reserved":0,"allocated":93011968,"data_stored":93011968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002127"},"pg_stats":[{"pgid":"8.7","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.154936+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:23.154936+0000","last_peered":"2024-09-16T16:56:23.154936+0000","last_clean":"2024-09-16T16:56:23.154936+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:23.154936+0000","last_undegraded":"2024-09-16T16:56:23.154936+0000","last_fullsized":"2024-09-16T16:56:23.154936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'56","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.069328+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:24.069328+0000","last_peered":"2024-09-16T16:56:24.069328+0000","last_clean":"2024-09-16T16:56:24.069328+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:24.069328+0000","last_undegraded":"2024-09-16T16:56:24.069328+0000","last_fullsized":"2024-09-16T16:56:24.069328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'48","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:16.873733+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:16.873733+0000","last_peered":"2024-09-16T16:56:16.873733+0000","last_clean":"2024-09-16T16:56:16.873733+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:16.873733+0000","last_undegraded":"2024-09-16T16:56:16.873733+0000","last_fullsized":"2024-09-16T16:56:16.873733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'136","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.784794+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:22.784794+0000","last_peered":"2024-09-16T16:56:22.784794+0000","last_clean":"2024-09-16T16:56:22.784794+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:22.784794+0000","last_undegraded":"2024-09-16T16:56:22.784794+0000","last_fullsized":"2024-09-16T16:56:22.784794+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'80","reported_seq":98,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.153924+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:24.153924+0000","last_peered":"2024-09-16T16:56:24.153924+0000","last_clean":"2024-09-16T16:56:24.153924+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:24.153924+0000","last_undegraded":"2024-09-16T16:56:24.153924+0000","last_fullsized":"2024-09-16T16:56:24.153924+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.447066+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:23.447066+0000","last_peered":"2024-09-16T16:56:23.447066+0000","last_clean":"2024-09-16T16:56:23.447066+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:23.447066+0000","last_undegraded":"2024-09-16T16:56:23.447066+0000","last_fullsized":"2024-09-16T16:56:23.447066+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'176","reported_seq":194,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.896468+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:23.896468+0000","last_peered":"2024-09-16T16:56:23.896468+0000","last_clean":"2024-09-16T16:56:23.896468+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:23.896468+0000","last_undegraded":"2024-09-16T16:56:23.896468+0000","last_fullsized":"2024-09-16T16:56:23.896468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.257344+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:24.257344+0000","last_peered":"2024-09-16T16:56:24.257344+0000","last_clean":"2024-09-16T16:56:24.257344+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:24.257344+0000","last_undegraded":"2024-09-16T16:56:24.257344+0000","last_fullsized":"2024-09-16T16:56:24.257344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.694413+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:23.694413+0000","last_peered":"2024-09-16T16:56:23.694413+0000","last_clean":"2024-09-16T16:56:23.694413+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:23.694413+0000","last_undegraded":"2024-09-16T16:56:23.694413+0000","last_fullsized":"2024-09-16T16:56:23.694413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'96","reported_seq":114,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.789124+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:23.789124+0000","last_peered":"2024-09-16T16:56:23.789124+0000","last_clean":"2024-09-16T16:56:23.789124+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:23.789124+0000","last_undegraded":"2024-09-16T16:56:23.789124+0000","last_fullsized":"2024-09-16T16:56:23.789124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.991102+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:23.991102+0000","last_peered":"2024-09-16T16:56:23.991102+0000","last_clean":"2024-09-16T16:56:23.991102+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:23.991102+0000","last_undegraded":"2024-09-16T16:56:23.991102+0000","last_fullsized":"2024-09-16T16:56:23.991102+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.115378+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:22.115378+0000","last_peered":"2024-09-16T16:56:22.115378+0000","last_clean":"2024-09-16T16:56:22.115378+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:22.115378+0000","last_undegraded":"2024-09-16T16:56:22.115378+0000","last_fullsized":"2024-09-16T16:56:22.115378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'72","reported_seq":90,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:21.394121+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:21.394121+0000","last_peered":"2024-09-16T16:56:21.394121+0000","last_clean":"2024-09-16T16:56:21.394121+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:21.394121+0000","last_undegraded":"2024-09-16T16:56:21.394121+0000","last_fullsized":"2024-09-16T16:56:21.394121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.320014+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:23.320014+0000","last_peered":"2024-09-16T16:56:23.320014+0000","last_clean":"2024-09-16T16:56:23.320014+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:23.320014+0000","last_undegraded":"2024-09-16T16:56:23.320014+0000","last_fullsized":"2024-09-16T16:56:23.320014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'144","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.672800+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:22.672800+0000","last_peered":"2024-09-16T16:56:22.672800+0000","last_clean":"2024-09-16T16:56:22.672800+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:22.672800+0000","last_undegraded":"2024-09-16T16:56:22.672800+0000","last_fullsized":"2024-09-16T16:56:22.672800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'101","reported_seq":119,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.358385+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:24.358385+0000","last_peered":"2024-09-16T16:56:24.358385+0000","last_clean":"2024-09-16T16:56:24.358385+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:24.358385+0000","last_undegraded":"2024-09-16T16:56:24.358385+0000","last_fullsized":"2024-09-16T16:56:24.358385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":827392,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1733,"ondisk_log_size":1733,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24388,"kb_used_data":24388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273340,"statfs":{"total":53552873472,"available":53527900160,"internally_reserved":0,"allocated":24973312,"data_stored":24973312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17144,"kb_used_data":17144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52280584,"statfs":{"total":53552873472,"available":53535318016,"internally_reserved":0,"allocated":17555456,"data_stored":17555456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24984,"kb_used_data":24984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272744,"statfs":{"total":53552873472,"available":53527289856,"internally_reserved":0,"allocated":25583616,"data_stored":25583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24316,"kb_used_data":24316,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273412,"statfs":{"total":53552873472,"available":53527973888,"internally_reserved":0,"allocated":24899584,"data_stored":24899584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:27.981 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:56:27.981 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:27.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:28.112+0000 7ff393d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:28.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:28.123+0000 7ff393d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:28.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 16 2157 2141 0.796429 0.835938 0.0938863 0.156547 2024-09-16T16:56:28.352 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:28.352 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:28.366 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-16T16:56:26.474415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14787123,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1814,"num_write_kb":14972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":90832,"kb_used_data":90832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209100080,"statfs":{"total":214211493888,"available":214118481920,"internally_reserved":0,"allocated":93011968,"data_stored":93011968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002127"},"pg_stats":[{"pgid":"8.7","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.154936+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:23.154936+0000","last_peered":"2024-09-16T16:56:23.154936+0000","last_clean":"2024-09-16T16:56:23.154936+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:23.154936+0000","last_undegraded":"2024-09-16T16:56:23.154936+0000","last_fullsized":"2024-09-16T16:56:23.154936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'56","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.069328+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:24.069328+0000","last_peered":"2024-09-16T16:56:24.069328+0000","last_clean":"2024-09-16T16:56:24.069328+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:24.069328+0000","last_undegraded":"2024-09-16T16:56:24.069328+0000","last_fullsized":"2024-09-16T16:56:24.069328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'48","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:16.873733+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:16.873733+0000","last_peered":"2024-09-16T16:56:16.873733+0000","last_clean":"2024-09-16T16:56:16.873733+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:16.873733+0000","last_undegraded":"2024-09-16T16:56:16.873733+0000","last_fullsized":"2024-09-16T16:56:16.873733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'136","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.784794+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:22.784794+0000","last_peered":"2024-09-16T16:56:22.784794+0000","last_clean":"2024-09-16T16:56:22.784794+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:22.784794+0000","last_undegraded":"2024-09-16T16:56:22.784794+0000","last_fullsized":"2024-09-16T16:56:22.784794+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'80","reported_seq":98,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.153924+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:24.153924+0000","last_peered":"2024-09-16T16:56:24.153924+0000","last_clean":"2024-09-16T16:56:24.153924+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:24.153924+0000","last_undegraded":"2024-09-16T16:56:24.153924+0000","last_fullsized":"2024-09-16T16:56:24.153924+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.447066+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:23.447066+0000","last_peered":"2024-09-16T16:56:23.447066+0000","last_clean":"2024-09-16T16:56:23.447066+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:23.447066+0000","last_undegraded":"2024-09-16T16:56:23.447066+0000","last_fullsized":"2024-09-16T16:56:23.447066+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'176","reported_seq":194,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.896468+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:23.896468+0000","last_peered":"2024-09-16T16:56:23.896468+0000","last_clean":"2024-09-16T16:56:23.896468+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:23.896468+0000","last_undegraded":"2024-09-16T16:56:23.896468+0000","last_fullsized":"2024-09-16T16:56:23.896468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.257344+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:24.257344+0000","last_peered":"2024-09-16T16:56:24.257344+0000","last_clean":"2024-09-16T16:56:24.257344+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:24.257344+0000","last_undegraded":"2024-09-16T16:56:24.257344+0000","last_fullsized":"2024-09-16T16:56:24.257344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.694413+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:23.694413+0000","last_peered":"2024-09-16T16:56:23.694413+0000","last_clean":"2024-09-16T16:56:23.694413+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:23.694413+0000","last_undegraded":"2024-09-16T16:56:23.694413+0000","last_fullsized":"2024-09-16T16:56:23.694413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'96","reported_seq":114,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.789124+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:23.789124+0000","last_peered":"2024-09-16T16:56:23.789124+0000","last_clean":"2024-09-16T16:56:23.789124+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:23.789124+0000","last_undegraded":"2024-09-16T16:56:23.789124+0000","last_fullsized":"2024-09-16T16:56:23.789124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.991102+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:23.991102+0000","last_peered":"2024-09-16T16:56:23.991102+0000","last_clean":"2024-09-16T16:56:23.991102+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:23.991102+0000","last_undegraded":"2024-09-16T16:56:23.991102+0000","last_fullsized":"2024-09-16T16:56:23.991102+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.115378+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:22.115378+0000","last_peered":"2024-09-16T16:56:22.115378+0000","last_clean":"2024-09-16T16:56:22.115378+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:22.115378+0000","last_undegraded":"2024-09-16T16:56:22.115378+0000","last_fullsized":"2024-09-16T16:56:22.115378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'72","reported_seq":90,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:21.394121+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:21.394121+0000","last_peered":"2024-09-16T16:56:21.394121+0000","last_clean":"2024-09-16T16:56:21.394121+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:21.394121+0000","last_undegraded":"2024-09-16T16:56:21.394121+0000","last_fullsized":"2024-09-16T16:56:21.394121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.320014+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:23.320014+0000","last_peered":"2024-09-16T16:56:23.320014+0000","last_clean":"2024-09-16T16:56:23.320014+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:23.320014+0000","last_undegraded":"2024-09-16T16:56:23.320014+0000","last_fullsized":"2024-09-16T16:56:23.320014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'144","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.672800+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:22.672800+0000","last_peered":"2024-09-16T16:56:22.672800+0000","last_clean":"2024-09-16T16:56:22.672800+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:22.672800+0000","last_undegraded":"2024-09-16T16:56:22.672800+0000","last_fullsized":"2024-09-16T16:56:22.672800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'101","reported_seq":119,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.358385+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:24.358385+0000","last_peered":"2024-09-16T16:56:24.358385+0000","last_clean":"2024-09-16T16:56:24.358385+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:24.358385+0000","last_undegraded":"2024-09-16T16:56:24.358385+0000","last_fullsized":"2024-09-16T16:56:24.358385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":827392,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1733,"ondisk_log_size":1733,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24388,"kb_used_data":24388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273340,"statfs":{"total":53552873472,"available":53527900160,"internally_reserved":0,"allocated":24973312,"data_stored":24973312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17144,"kb_used_data":17144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52280584,"statfs":{"total":53552873472,"available":53535318016,"internally_reserved":0,"allocated":17555456,"data_stored":17555456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24984,"kb_used_data":24984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272744,"statfs":{"total":53552873472,"available":53527289856,"internally_reserved":0,"allocated":25583616,"data_stored":25583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24316,"kb_used_data":24316,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273412,"statfs":{"total":53552873472,"available":53527973888,"internally_reserved":0,"allocated":24899584,"data_stored":24899584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:29.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2269 2253 0.799997 0.875 0.0620547 0.155734 2024-09-16T16:56:29.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:29.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:29.687+0000 7ff508591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:29.694+0000 7ff508591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:30.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2377 2361 0.801895 0.84375 0.177033 0.155135 2024-09-16T16:56:31.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2486 2470 0.803958 0.851562 0.112482 0.15489 2024-09-16T16:56:31.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:32.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:32.132+0000 7f0008391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:32.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:32.141+0000 7f0008391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:32.301 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2573 2557 0.798985 0.679688 0.0626356 0.155402 2024-09-16T16:56:33.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 2692 2676 0.804008 0.929688 0.0585851 0.155003 2024-09-16T16:56:33.368 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:33.369 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:33.369 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:33.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:33.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:33.495+0000 7ff000391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:33.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:33.508+0000 7ff000391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:33.541 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:33.542 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:33.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:33.546 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:33.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:33.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:33.682+0000 7fa0b6511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:33.694+0000 7fa0b6511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:33.716 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:33.717 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:33.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:33.720 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:33.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:33.844+0000 7feeca791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:33.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:33.856+0000 7feeca791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:33.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:33.881 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:33.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:34.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:34.055+0000 7fc5ac4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:34.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:34.069+0000 7fc5ac4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:34.097 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:34.097 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:34.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 2793 2777 0.803451 0.789062 0.135826 0.155045 2024-09-16T16:56:34.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:34.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:34.509+0000 7f9dc8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:34.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:34.518+0000 7f9dc8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:35.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 2891 2875 0.802097 0.765625 0.182029 0.155106 2024-09-16T16:56:36.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 2994 2978 0.802184 0.804688 0.181411 0.155156 2024-09-16T16:56:36.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:36.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:36.964+0000 7f8ceed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:36.975+0000 7f8ceed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:37.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 3091 3075 0.800702 0.757812 0.353515 0.155269 2024-09-16T16:56:38.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3196 3180 0.801332 0.820312 0.228681 0.155703 2024-09-16T16:56:39.099 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:39.099 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:39.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:39.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:39.249+0000 7f3c07d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:39.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:39.281+0000 7f3c07d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:39.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3312 3296 0.804608 0.90625 0.146825 0.154976 2024-09-16T16:56:39.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:39.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:39.491+0000 7f19f9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:39.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:39.504+0000 7f19f9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:39.652 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:39.652 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-16T16:56:38.476611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14787123,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1814,"num_write_kb":14972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":90832,"kb_used_data":90832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209100080,"statfs":{"total":214211493888,"available":214118481920,"internally_reserved":0,"allocated":93011968,"data_stored":93011968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002196"},"pg_stats":[{"pgid":"8.7","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.154936+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:23.154936+0000","last_peered":"2024-09-16T16:56:23.154936+0000","last_clean":"2024-09-16T16:56:23.154936+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:23.154936+0000","last_undegraded":"2024-09-16T16:56:23.154936+0000","last_fullsized":"2024-09-16T16:56:23.154936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'56","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.069328+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:24.069328+0000","last_peered":"2024-09-16T16:56:24.069328+0000","last_clean":"2024-09-16T16:56:24.069328+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:24.069328+0000","last_undegraded":"2024-09-16T16:56:24.069328+0000","last_fullsized":"2024-09-16T16:56:24.069328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'48","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:16.873733+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:16.873733+0000","last_peered":"2024-09-16T16:56:16.873733+0000","last_clean":"2024-09-16T16:56:16.873733+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:16.873733+0000","last_undegraded":"2024-09-16T16:56:16.873733+0000","last_fullsized":"2024-09-16T16:56:16.873733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'136","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.784794+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:22.784794+0000","last_peered":"2024-09-16T16:56:22.784794+0000","last_clean":"2024-09-16T16:56:22.784794+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:22.784794+0000","last_undegraded":"2024-09-16T16:56:22.784794+0000","last_fullsized":"2024-09-16T16:56:22.784794+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'80","reported_seq":98,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.153924+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:24.153924+0000","last_peered":"2024-09-16T16:56:24.153924+0000","last_clean":"2024-09-16T16:56:24.153924+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:24.153924+0000","last_undegraded":"2024-09-16T16:56:24.153924+0000","last_fullsized":"2024-09-16T16:56:24.153924+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.447066+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:23.447066+0000","last_peered":"2024-09-16T16:56:23.447066+0000","last_clean":"2024-09-16T16:56:23.447066+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:23.447066+0000","last_undegraded":"2024-09-16T16:56:23.447066+0000","last_fullsized":"2024-09-16T16:56:23.447066+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'176","reported_seq":194,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.896468+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:23.896468+0000","last_peered":"2024-09-16T16:56:23.896468+0000","last_clean":"2024-09-16T16:56:23.896468+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:23.896468+0000","last_undegraded":"2024-09-16T16:56:23.896468+0000","last_fullsized":"2024-09-16T16:56:23.896468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.257344+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:24.257344+0000","last_peered":"2024-09-16T16:56:24.257344+0000","last_clean":"2024-09-16T16:56:24.257344+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:24.257344+0000","last_undegraded":"2024-09-16T16:56:24.257344+0000","last_fullsized":"2024-09-16T16:56:24.257344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.694413+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:23.694413+0000","last_peered":"2024-09-16T16:56:23.694413+0000","last_clean":"2024-09-16T16:56:23.694413+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:23.694413+0000","last_undegraded":"2024-09-16T16:56:23.694413+0000","last_fullsized":"2024-09-16T16:56:23.694413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'96","reported_seq":114,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.789124+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:23.789124+0000","last_peered":"2024-09-16T16:56:23.789124+0000","last_clean":"2024-09-16T16:56:23.789124+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:23.789124+0000","last_undegraded":"2024-09-16T16:56:23.789124+0000","last_fullsized":"2024-09-16T16:56:23.789124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.991102+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:23.991102+0000","last_peered":"2024-09-16T16:56:23.991102+0000","last_clean":"2024-09-16T16:56:23.991102+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:23.991102+0000","last_undegraded":"2024-09-16T16:56:23.991102+0000","last_fullsized":"2024-09-16T16:56:23.991102+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.115378+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:22.115378+0000","last_peered":"2024-09-16T16:56:22.115378+0000","last_clean":"2024-09-16T16:56:22.115378+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:22.115378+0000","last_undegraded":"2024-09-16T16:56:22.115378+0000","last_fullsized":"2024-09-16T16:56:22.115378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'72","reported_seq":90,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:21.394121+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:21.394121+0000","last_peered":"2024-09-16T16:56:21.394121+0000","last_clean":"2024-09-16T16:56:21.394121+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:21.394121+0000","last_undegraded":"2024-09-16T16:56:21.394121+0000","last_fullsized":"2024-09-16T16:56:21.394121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.320014+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:23.320014+0000","last_peered":"2024-09-16T16:56:23.320014+0000","last_clean":"2024-09-16T16:56:23.320014+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:23.320014+0000","last_undegraded":"2024-09-16T16:56:23.320014+0000","last_fullsized":"2024-09-16T16:56:23.320014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'144","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.672800+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:22.672800+0000","last_peered":"2024-09-16T16:56:22.672800+0000","last_clean":"2024-09-16T16:56:22.672800+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:22.672800+0000","last_undegraded":"2024-09-16T16:56:22.672800+0000","last_fullsized":"2024-09-16T16:56:22.672800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'101","reported_seq":119,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.358385+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:24.358385+0000","last_peered":"2024-09-16T16:56:24.358385+0000","last_clean":"2024-09-16T16:56:24.358385+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:24.358385+0000","last_undegraded":"2024-09-16T16:56:24.358385+0000","last_fullsized":"2024-09-16T16:56:24.358385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":827392,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1733,"ondisk_log_size":1733,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24388,"kb_used_data":24388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273340,"statfs":{"total":53552873472,"available":53527900160,"internally_reserved":0,"allocated":24973312,"data_stored":24973312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17144,"kb_used_data":17144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52280584,"statfs":{"total":53552873472,"available":53535318016,"internally_reserved":0,"allocated":17555456,"data_stored":17555456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24984,"kb_used_data":24984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272744,"statfs":{"total":53552873472,"available":53527289856,"internally_reserved":0,"allocated":25583616,"data_stored":25583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24316,"kb_used_data":24316,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273412,"statfs":{"total":53552873472,"available":53527973888,"internally_reserved":0,"allocated":24899584,"data_stored":24899584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:40.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3426 3410 0.807211 0.890625 0.124967 0.154538 2024-09-16T16:56:41.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3550 3534 0.81196 0.96875 0.0660784 0.153643 2024-09-16T16:56:41.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:41.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:41.978+0000 7fd530a5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:41.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:41.985+0000 7fd530a5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:42.302 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 3632 3616 0.807063 0.640625 0.154043 0.154547 2024-09-16T16:56:43.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 3745 3729 0.809164 0.882812 0.157966 0.15413 2024-09-16T16:56:44.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 3852 3836 0.809886 0.835938 0.0927757 0.154072 2024-09-16T16:56:44.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:44.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:44.567+0000 7f7aa42bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:44.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:44.575+0000 7f7aa42bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:44.675 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:44.675 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:44.675 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:56:44.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:56:44.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:44.850+0000 7fd5eef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:44.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:44.864+0000 7fd5eef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.076 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:45.077 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:45.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:45.081 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:45.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:56:45.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:45.224+0000 7f6465f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:45.237+0000 7f6465f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 3949 3933 0.808513 0.757812 0.164209 0.154231 2024-09-16T16:56:45.346 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:45.346 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:45.350 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:45.350 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:45.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:56:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:45.470+0000 7f0744b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:45.482+0000 7f0744b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.501 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:45.501 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:45.502 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:45.505 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:45.506 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:45.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:56:45.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:45.636+0000 7f176a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:45.649+0000 7f176a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:56:45.672 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:56:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:56:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:56:45.676 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:56:45.676 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:56:46.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 4038 4022 0.805609 0.695312 0.0734085 0.154912 2024-09-16T16:56:46.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:47.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:47.115+0000 7f924cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:47.126+0000 7f924cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:47.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:56:47.303328+0000 min lat: 0.0225454 max lat: 0.607218 avg lat: 0.154564 2024-09-16T16:56:47.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:56:47.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4150 4134 0.807342 0.875 0.131305 0.154564 2024-09-16T16:56:48.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4243 4227 0.805369 0.726562 0.293246 0.154752 2024-09-16T16:56:49.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4345 4329 0.805164 0.796875 0.0858964 0.154769 2024-09-16T16:56:49.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:49.526+0000 7f02dbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:49.534+0000 7f02dbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:50.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4424 4408 0.800791 0.617188 0.282919 0.155409 2024-09-16T16:56:50.678 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:50.678 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:50.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:50.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:50.800+0000 7f59c086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:50.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:50.810+0000 7f59c086c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:51.016 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:51.016 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:51.031 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-16T16:56:50.478675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14787123,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1814,"num_write_kb":14972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":90832,"kb_used_data":90832,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209100080,"statfs":{"total":214211493888,"available":214118481920,"internally_reserved":0,"allocated":93011968,"data_stored":93011968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002064"},"pg_stats":[{"pgid":"8.7","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.154936+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:23.154936+0000","last_peered":"2024-09-16T16:56:23.154936+0000","last_clean":"2024-09-16T16:56:23.154936+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:23.154936+0000","last_undegraded":"2024-09-16T16:56:23.154936+0000","last_fullsized":"2024-09-16T16:56:23.154936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'56","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.069328+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:24.069328+0000","last_peered":"2024-09-16T16:56:24.069328+0000","last_clean":"2024-09-16T16:56:24.069328+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:24.069328+0000","last_undegraded":"2024-09-16T16:56:24.069328+0000","last_fullsized":"2024-09-16T16:56:24.069328+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'48","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:16.873733+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:16.873733+0000","last_peered":"2024-09-16T16:56:16.873733+0000","last_clean":"2024-09-16T16:56:16.873733+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:16.873733+0000","last_undegraded":"2024-09-16T16:56:16.873733+0000","last_fullsized":"2024-09-16T16:56:16.873733+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'136","reported_seq":154,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.784794+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:22.784794+0000","last_peered":"2024-09-16T16:56:22.784794+0000","last_clean":"2024-09-16T16:56:22.784794+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:22.784794+0000","last_undegraded":"2024-09-16T16:56:22.784794+0000","last_fullsized":"2024-09-16T16:56:22.784794+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'80","reported_seq":98,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.153924+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:24.153924+0000","last_peered":"2024-09-16T16:56:24.153924+0000","last_clean":"2024-09-16T16:56:24.153924+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:24.153924+0000","last_undegraded":"2024-09-16T16:56:24.153924+0000","last_fullsized":"2024-09-16T16:56:24.153924+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.447066+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:23.447066+0000","last_peered":"2024-09-16T16:56:23.447066+0000","last_clean":"2024-09-16T16:56:23.447066+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:23.447066+0000","last_undegraded":"2024-09-16T16:56:23.447066+0000","last_fullsized":"2024-09-16T16:56:23.447066+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'176","reported_seq":194,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.896468+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:23.896468+0000","last_peered":"2024-09-16T16:56:23.896468+0000","last_clean":"2024-09-16T16:56:23.896468+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:23.896468+0000","last_undegraded":"2024-09-16T16:56:23.896468+0000","last_fullsized":"2024-09-16T16:56:23.896468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.257344+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:24.257344+0000","last_peered":"2024-09-16T16:56:24.257344+0000","last_clean":"2024-09-16T16:56:24.257344+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:24.257344+0000","last_undegraded":"2024-09-16T16:56:24.257344+0000","last_fullsized":"2024-09-16T16:56:24.257344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.694413+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:23.694413+0000","last_peered":"2024-09-16T16:56:23.694413+0000","last_clean":"2024-09-16T16:56:23.694413+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:23.694413+0000","last_undegraded":"2024-09-16T16:56:23.694413+0000","last_fullsized":"2024-09-16T16:56:23.694413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'96","reported_seq":114,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.789124+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:23.789124+0000","last_peered":"2024-09-16T16:56:23.789124+0000","last_clean":"2024-09-16T16:56:23.789124+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:23.789124+0000","last_undegraded":"2024-09-16T16:56:23.789124+0000","last_fullsized":"2024-09-16T16:56:23.789124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'120","reported_seq":138,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.991102+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:23.991102+0000","last_peered":"2024-09-16T16:56:23.991102+0000","last_clean":"2024-09-16T16:56:23.991102+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:23.991102+0000","last_undegraded":"2024-09-16T16:56:23.991102+0000","last_fullsized":"2024-09-16T16:56:23.991102+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'104","reported_seq":122,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.115378+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:22.115378+0000","last_peered":"2024-09-16T16:56:22.115378+0000","last_clean":"2024-09-16T16:56:22.115378+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:22.115378+0000","last_undegraded":"2024-09-16T16:56:22.115378+0000","last_fullsized":"2024-09-16T16:56:22.115378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'72","reported_seq":90,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:21.394121+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:21.394121+0000","last_peered":"2024-09-16T16:56:21.394121+0000","last_clean":"2024-09-16T16:56:21.394121+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:21.394121+0000","last_undegraded":"2024-09-16T16:56:21.394121+0000","last_fullsized":"2024-09-16T16:56:21.394121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'128","reported_seq":146,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:23.320014+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:23.320014+0000","last_peered":"2024-09-16T16:56:23.320014+0000","last_clean":"2024-09-16T16:56:23.320014+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:23.320014+0000","last_undegraded":"2024-09-16T16:56:23.320014+0000","last_fullsized":"2024-09-16T16:56:23.320014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'144","reported_seq":162,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:22.672800+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:22.672800+0000","last_peered":"2024-09-16T16:56:22.672800+0000","last_clean":"2024-09-16T16:56:22.672800+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:22.672800+0000","last_undegraded":"2024-09-16T16:56:22.672800+0000","last_fullsized":"2024-09-16T16:56:22.672800+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'101","reported_seq":119,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:24.358385+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:24.358385+0000","last_peered":"2024-09-16T16:56:24.358385+0000","last_clean":"2024-09-16T16:56:24.358385+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:24.358385+0000","last_undegraded":"2024-09-16T16:56:24.358385+0000","last_fullsized":"2024-09-16T16:56:24.358385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":827392,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":14196736,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1733,"num_write_kb":13864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1733,"ondisk_log_size":1733,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214115426304,"internally_reserved":0,"allocated":96067584,"data_stored":96067584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24388,"kb_used_data":24388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273340,"statfs":{"total":53552873472,"available":53527900160,"internally_reserved":0,"allocated":24973312,"data_stored":24973312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":17144,"kb_used_data":17144,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52280584,"statfs":{"total":53552873472,"available":53535318016,"internally_reserved":0,"allocated":17555456,"data_stored":17555456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24984,"kb_used_data":24984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52272744,"statfs":{"total":53552873472,"available":53527289856,"internally_reserved":0,"allocated":25583616,"data_stored":25583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":24316,"kb_used_data":24316,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52273412,"statfs":{"total":53552873472,"available":53527973888,"internally_reserved":0,"allocated":24899584,"data_stored":24899584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53526994944,"internally_reserved":0,"allocated":25878528,"data_stored":25878528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53526429696,"internally_reserved":0,"allocated":26443776,"data_stored":26443776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53534924800,"internally_reserved":0,"allocated":17948672,"data_stored":17948672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53527076864,"internally_reserved":0,"allocated":25796608,"data_stored":25796608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:51.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 16 4528 4512 0.801055 0.8125 0.107309 0.15583 2024-09-16T16:56:51.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:51.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:51.932+0000 7f6e78711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:51.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:51.940+0000 7f6e78711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:52.303 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 4602 4586 0.7961 0.578125 0.362561 0.156522 2024-09-16T16:56:53.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 4685 4669 0.792889 0.648438 0.0509032 0.157222 2024-09-16T16:56:54.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:54.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 16 4800 4784 0.795132 0.898438 0.184465 0.15688 2024-09-16T16:56:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:54.370+0000 7f1859f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:54.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:54.378+0000 7f1859f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:55.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 4906 4890 0.795818 0.828125 0.11506 0.156877 2024-09-16T16:56:56.033 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:56:56.034 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:56:56.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:56:56.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:56.208+0000 7fad85191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:56.219+0000 7fad85191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 5017 5001 0.797273 0.867188 0.133926 0.156334 2024-09-16T16:56:56.503 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:56:56.504 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:56:56.520 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-16T16:56:56.479956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39961139,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4887,"num_write_kb":39556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4861,"ondisk_log_size":4861,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":242052,"kb_used_data":242052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208948860,"statfs":{"total":214211493888,"available":213963632640,"internally_reserved":0,"allocated":247861248,"data_stored":247861248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25174016,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3073,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002386"},"pg_stats":[{"pgid":"8.7","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.832939+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:53.832939+0000","last_peered":"2024-09-16T16:56:53.832939+0000","last_clean":"2024-09-16T16:56:53.832939+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:53.832939+0000","last_undegraded":"2024-09-16T16:56:53.832939+0000","last_fullsized":"2024-09-16T16:56:53.832939+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'240","reported_seq":258,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.949095+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:53.949095+0000","last_peered":"2024-09-16T16:56:53.949095+0000","last_clean":"2024-09-16T16:56:53.949095+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:53.949095+0000","last_undegraded":"2024-09-16T16:56:53.949095+0000","last_fullsized":"2024-09-16T16:56:53.949095+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.985595+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:52.985595+0000","last_peered":"2024-09-16T16:56:52.985595+0000","last_clean":"2024-09-16T16:56:52.985595+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:52.985595+0000","last_undegraded":"2024-09-16T16:56:52.985595+0000","last_fullsized":"2024-09-16T16:56:52.985595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'336","reported_seq":354,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.037581+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:54.037581+0000","last_peered":"2024-09-16T16:56:54.037581+0000","last_clean":"2024-09-16T16:56:54.037581+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:54.037581+0000","last_undegraded":"2024-09-16T16:56:54.037581+0000","last_fullsized":"2024-09-16T16:56:54.037581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'304","reported_seq":322,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.169682+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:54.169682+0000","last_peered":"2024-09-16T16:56:54.169682+0000","last_clean":"2024-09-16T16:56:54.169682+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:54.169682+0000","last_undegraded":"2024-09-16T16:56:54.169682+0000","last_fullsized":"2024-09-16T16:56:54.169682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'264","reported_seq":282,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:50.414332+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:50.414332+0000","last_peered":"2024-09-16T16:56:50.414332+0000","last_clean":"2024-09-16T16:56:50.414332+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:50.414332+0000","last_undegraded":"2024-09-16T16:56:50.414332+0000","last_fullsized":"2024-09-16T16:56:50.414332+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'368","reported_seq":386,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.749374+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:53.749374+0000","last_peered":"2024-09-16T16:56:53.749374+0000","last_clean":"2024-09-16T16:56:53.749374+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:53.749374+0000","last_undegraded":"2024-09-16T16:56:53.749374+0000","last_fullsized":"2024-09-16T16:56:53.749374+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'232","reported_seq":250,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:51.809784+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:51.809784+0000","last_peered":"2024-09-16T16:56:51.809784+0000","last_clean":"2024-09-16T16:56:51.809784+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:51.809784+0000","last_undegraded":"2024-09-16T16:56:51.809784+0000","last_fullsized":"2024-09-16T16:56:51.809784+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.237093+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:54.237093+0000","last_peered":"2024-09-16T16:56:54.237093+0000","last_clean":"2024-09-16T16:56:54.237093+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:54.237093+0000","last_undegraded":"2024-09-16T16:56:54.237093+0000","last_fullsized":"2024-09-16T16:56:54.237093+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'288","reported_seq":306,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.331236+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:53.331236+0000","last_peered":"2024-09-16T16:56:53.331236+0000","last_clean":"2024-09-16T16:56:53.331236+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:53.331236+0000","last_undegraded":"2024-09-16T16:56:53.331236+0000","last_fullsized":"2024-09-16T16:56:53.331236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'280","reported_seq":298,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:47.071494+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:47.071494+0000","last_peered":"2024-09-16T16:56:47.071494+0000","last_clean":"2024-09-16T16:56:47.071494+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:47.071494+0000","last_undegraded":"2024-09-16T16:56:47.071494+0000","last_fullsized":"2024-09-16T16:56:47.071494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'238","reported_seq":256,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.379953+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:54.379953+0000","last_peered":"2024-09-16T16:56:54.379953+0000","last_clean":"2024-09-16T16:56:54.379953+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:54.379953+0000","last_undegraded":"2024-09-16T16:56:54.379953+0000","last_fullsized":"2024-09-16T16:56:54.379953+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1949696,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":1904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.505964+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:53.505964+0000","last_peered":"2024-09-16T16:56:53.505964+0000","last_clean":"2024-09-16T16:56:53.505964+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:53.505964+0000","last_undegraded":"2024-09-16T16:56:53.505964+0000","last_fullsized":"2024-09-16T16:56:53.505964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.302107+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:54.302107+0000","last_peered":"2024-09-16T16:56:54.302107+0000","last_clean":"2024-09-16T16:56:54.302107+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:54.302107+0000","last_undegraded":"2024-09-16T16:56:54.302107+0000","last_fullsized":"2024-09-16T16:56:54.302107+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.436459+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:53.436459+0000","last_peered":"2024-09-16T16:56:53.436459+0000","last_clean":"2024-09-16T16:56:53.436459+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:53.436459+0000","last_undegraded":"2024-09-16T16:56:53.436459+0000","last_fullsized":"2024-09-16T16:56:53.436459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.099186+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:54.099186+0000","last_peered":"2024-09-16T16:56:54.099186+0000","last_clean":"2024-09-16T16:56:54.099186+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:54.099186+0000","last_undegraded":"2024-09-16T16:56:54.099186+0000","last_fullsized":"2024-09-16T16:56:54.099186+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":39370752,"num_objects":601,"num_object_clones":0,"num_object_copies":1803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4806,"num_write_kb":38448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959663616,"internally_reserved":0,"allocated":251830272,"data_stored":251830272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4806,"ondisk_log_size":4806,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959671808,"internally_reserved":0,"allocated":251822080,"data_stored":251822080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61280,"kb_used_data":61280,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236448,"statfs":{"total":53552873472,"available":53490122752,"internally_reserved":0,"allocated":62750720,"data_stored":62750720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":44952,"kb_used_data":44952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52252776,"statfs":{"total":53552873472,"available":53506842624,"internally_reserved":0,"allocated":46030848,"data_stored":46030848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":69840,"kb_used_data":69840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52227888,"statfs":{"total":53552873472,"available":53481357312,"internally_reserved":0,"allocated":71516160,"data_stored":71516160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65980,"kb_used_data":65980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231748,"statfs":{"total":53552873472,"available":53485309952,"internally_reserved":0,"allocated":67563520,"data_stored":67563520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53488963584,"internally_reserved":0,"allocated":63909888,"data_stored":63909888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:56:56.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:56:56.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:56.810+0000 7f4ee8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:56.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:56.818+0000 7f4ee8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:57.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 5122 5106 0.797732 0.820312 0.0597905 0.156442 2024-09-16T16:56:58.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5223 5207 0.797561 0.789062 0.127632 0.156423 2024-09-16T16:56:59.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:56:59.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:59.291+0000 7f33ae151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:56:59.300+0000 7f33ae151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:56:59.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 16 5334 5318 0.798898 0.867188 0.125402 0.156143 2024-09-16T16:57:00.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 5437 5421 0.799006 0.804688 0.117514 0.15625 2024-09-16T16:57:01.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 5533 5517 0.798097 0.75 0.310369 0.155998 2024-09-16T16:57:01.521 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:01.521 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:01.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:01.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:01.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:01.687+0000 7f7905e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:01.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:01.700+0000 7f7905e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:01.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:01.839+0000 7fb829991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:01.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:01.850+0000 7fb829991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:01.982 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:01.983 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:02.005 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-09-16T16:57:00.480814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39961139,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4887,"num_write_kb":39556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4861,"ondisk_log_size":4861,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":242052,"kb_used_data":242052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208948860,"statfs":{"total":214211493888,"available":213963632640,"internally_reserved":0,"allocated":247861248,"data_stored":247861248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25174016,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3073,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002485"},"pg_stats":[{"pgid":"8.7","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.832939+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:53.832939+0000","last_peered":"2024-09-16T16:56:53.832939+0000","last_clean":"2024-09-16T16:56:53.832939+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:53.832939+0000","last_undegraded":"2024-09-16T16:56:53.832939+0000","last_fullsized":"2024-09-16T16:56:53.832939+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'240","reported_seq":258,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.949095+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:53.949095+0000","last_peered":"2024-09-16T16:56:53.949095+0000","last_clean":"2024-09-16T16:56:53.949095+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:53.949095+0000","last_undegraded":"2024-09-16T16:56:53.949095+0000","last_fullsized":"2024-09-16T16:56:53.949095+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.985595+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:52.985595+0000","last_peered":"2024-09-16T16:56:52.985595+0000","last_clean":"2024-09-16T16:56:52.985595+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:52.985595+0000","last_undegraded":"2024-09-16T16:56:52.985595+0000","last_fullsized":"2024-09-16T16:56:52.985595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'336","reported_seq":354,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.037581+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:54.037581+0000","last_peered":"2024-09-16T16:56:54.037581+0000","last_clean":"2024-09-16T16:56:54.037581+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:54.037581+0000","last_undegraded":"2024-09-16T16:56:54.037581+0000","last_fullsized":"2024-09-16T16:56:54.037581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'304","reported_seq":322,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.169682+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:54.169682+0000","last_peered":"2024-09-16T16:56:54.169682+0000","last_clean":"2024-09-16T16:56:54.169682+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:54.169682+0000","last_undegraded":"2024-09-16T16:56:54.169682+0000","last_fullsized":"2024-09-16T16:56:54.169682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'264","reported_seq":282,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:50.414332+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:50.414332+0000","last_peered":"2024-09-16T16:56:50.414332+0000","last_clean":"2024-09-16T16:56:50.414332+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:50.414332+0000","last_undegraded":"2024-09-16T16:56:50.414332+0000","last_fullsized":"2024-09-16T16:56:50.414332+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'368","reported_seq":386,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.749374+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:53.749374+0000","last_peered":"2024-09-16T16:56:53.749374+0000","last_clean":"2024-09-16T16:56:53.749374+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:53.749374+0000","last_undegraded":"2024-09-16T16:56:53.749374+0000","last_fullsized":"2024-09-16T16:56:53.749374+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'232","reported_seq":250,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:51.809784+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:51.809784+0000","last_peered":"2024-09-16T16:56:51.809784+0000","last_clean":"2024-09-16T16:56:51.809784+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:51.809784+0000","last_undegraded":"2024-09-16T16:56:51.809784+0000","last_fullsized":"2024-09-16T16:56:51.809784+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.237093+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:54.237093+0000","last_peered":"2024-09-16T16:56:54.237093+0000","last_clean":"2024-09-16T16:56:54.237093+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:54.237093+0000","last_undegraded":"2024-09-16T16:56:54.237093+0000","last_fullsized":"2024-09-16T16:56:54.237093+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'288","reported_seq":306,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.331236+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:53.331236+0000","last_peered":"2024-09-16T16:56:53.331236+0000","last_clean":"2024-09-16T16:56:53.331236+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:53.331236+0000","last_undegraded":"2024-09-16T16:56:53.331236+0000","last_fullsized":"2024-09-16T16:56:53.331236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'280","reported_seq":298,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:47.071494+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:47.071494+0000","last_peered":"2024-09-16T16:56:47.071494+0000","last_clean":"2024-09-16T16:56:47.071494+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:47.071494+0000","last_undegraded":"2024-09-16T16:56:47.071494+0000","last_fullsized":"2024-09-16T16:56:47.071494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'238","reported_seq":256,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.379953+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:54.379953+0000","last_peered":"2024-09-16T16:56:54.379953+0000","last_clean":"2024-09-16T16:56:54.379953+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:54.379953+0000","last_undegraded":"2024-09-16T16:56:54.379953+0000","last_fullsized":"2024-09-16T16:56:54.379953+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1949696,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":1904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.505964+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:53.505964+0000","last_peered":"2024-09-16T16:56:53.505964+0000","last_clean":"2024-09-16T16:56:53.505964+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:53.505964+0000","last_undegraded":"2024-09-16T16:56:53.505964+0000","last_fullsized":"2024-09-16T16:56:53.505964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.302107+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:54.302107+0000","last_peered":"2024-09-16T16:56:54.302107+0000","last_clean":"2024-09-16T16:56:54.302107+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:54.302107+0000","last_undegraded":"2024-09-16T16:56:54.302107+0000","last_fullsized":"2024-09-16T16:56:54.302107+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.436459+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:53.436459+0000","last_peered":"2024-09-16T16:56:53.436459+0000","last_clean":"2024-09-16T16:56:53.436459+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:53.436459+0000","last_undegraded":"2024-09-16T16:56:53.436459+0000","last_fullsized":"2024-09-16T16:56:53.436459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.099186+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:54.099186+0000","last_peered":"2024-09-16T16:56:54.099186+0000","last_clean":"2024-09-16T16:56:54.099186+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:54.099186+0000","last_undegraded":"2024-09-16T16:56:54.099186+0000","last_fullsized":"2024-09-16T16:56:54.099186+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":39370752,"num_objects":601,"num_object_clones":0,"num_object_copies":1803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4806,"num_write_kb":38448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959663616,"internally_reserved":0,"allocated":251830272,"data_stored":251830272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4806,"ondisk_log_size":4806,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959671808,"internally_reserved":0,"allocated":251822080,"data_stored":251822080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61280,"kb_used_data":61280,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236448,"statfs":{"total":53552873472,"available":53490122752,"internally_reserved":0,"allocated":62750720,"data_stored":62750720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":44952,"kb_used_data":44952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52252776,"statfs":{"total":53552873472,"available":53506842624,"internally_reserved":0,"allocated":46030848,"data_stored":46030848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":69840,"kb_used_data":69840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52227888,"statfs":{"total":53552873472,"available":53481357312,"internally_reserved":0,"allocated":71516160,"data_stored":71516160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65980,"kb_used_data":65980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231748,"statfs":{"total":53552873472,"available":53485309952,"internally_reserved":0,"allocated":67563520,"data_stored":67563520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53488963584,"internally_reserved":0,"allocated":63909888,"data_stored":63909888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:02.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 5640 5624 0.798783 0.835938 0.137796 0.156265 2024-09-16T16:57:03.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 5746 5730 0.799306 0.828125 0.395895 0.15604 2024-09-16T16:57:04.295 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:04.304 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 5847 5831 0.799125 0.789062 0.223291 0.156031 2024-09-16T16:57:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:04.460+0000 7f7ee0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:04.473+0000 7f7ee0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:05.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 5927 5911 0.796122 0.625 0.0968055 0.156765 2024-09-16T16:57:06.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 6021 6005 0.795074 0.734375 0.18071 0.15696 2024-09-16T16:57:06.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:06.867+0000 7f79e446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:06.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:06.875+0000 7f79e446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.007 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:07.007 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:07.008 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:57:07.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:57:07.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.130+0000 7f5f572d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.146+0000 7f5f572d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.225 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:07.226 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:07.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:07.230 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:07.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:57:07.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:57:07.305325+0000 min lat: 0.0225454 max lat: 0.720271 avg lat: 0.157184 2024-09-16T16:57:07.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:57:07.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 6083 6067 0.789895 0.484375 0.0453057 0.157184 2024-09-16T16:57:07.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.390+0000 7ff07c67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.408+0000 7ff07c67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.526 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:07.531 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:07.531 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:07.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:57:07.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.655+0000 7f3d01911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.667+0000 7f3d01911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:07.684 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:07.688 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:07.688 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:07.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:57:07.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.807+0000 7fca7fe6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:07.818+0000 7fca7fe6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:07.839 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:07.839 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:07.839 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:07.842 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:07.842 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:08.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 6153 6137 0.78591 0.546875 0.220338 0.158706 2024-09-16T16:57:09.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:09.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:09.189+0000 7f3335293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:09.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:09.200+0000 7f3335293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:09.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6248 6232 0.785204 0.742188 0.127042 0.158983 2024-09-16T16:57:10.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 6336 6320 0.783652 0.6875 0.327637 0.159199 2024-09-16T16:57:11.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 16 6440 6424 0.784102 0.8125 0.161021 0.15923 2024-09-16T16:57:11.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:11.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:11.669+0000 7fc6a6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:11.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:11.679+0000 7fc6a6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:12.305 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 6543 6527 0.784417 0.804688 0.112156 0.159125 2024-09-16T16:57:12.843 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:12.843 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:12.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:12.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:12.980+0000 7f01e7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:12.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:12.992+0000 7f01e7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:13.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:13.273 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-16T16:57:12.483133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39961139,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4887,"num_write_kb":39556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4861,"ondisk_log_size":4861,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":242052,"kb_used_data":242052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208948860,"statfs":{"total":214211493888,"available":213963632640,"internally_reserved":0,"allocated":247861248,"data_stored":247861248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002319"},"pg_stats":[{"pgid":"8.7","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.832939+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:53.832939+0000","last_peered":"2024-09-16T16:56:53.832939+0000","last_clean":"2024-09-16T16:56:53.832939+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:53.832939+0000","last_undegraded":"2024-09-16T16:56:53.832939+0000","last_fullsized":"2024-09-16T16:56:53.832939+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'240","reported_seq":258,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.949095+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:53.949095+0000","last_peered":"2024-09-16T16:56:53.949095+0000","last_clean":"2024-09-16T16:56:53.949095+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:53.949095+0000","last_undegraded":"2024-09-16T16:56:53.949095+0000","last_fullsized":"2024-09-16T16:56:53.949095+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.985595+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:52.985595+0000","last_peered":"2024-09-16T16:56:52.985595+0000","last_clean":"2024-09-16T16:56:52.985595+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:52.985595+0000","last_undegraded":"2024-09-16T16:56:52.985595+0000","last_fullsized":"2024-09-16T16:56:52.985595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'336","reported_seq":354,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.037581+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:54.037581+0000","last_peered":"2024-09-16T16:56:54.037581+0000","last_clean":"2024-09-16T16:56:54.037581+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:54.037581+0000","last_undegraded":"2024-09-16T16:56:54.037581+0000","last_fullsized":"2024-09-16T16:56:54.037581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'304","reported_seq":322,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.169682+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:54.169682+0000","last_peered":"2024-09-16T16:56:54.169682+0000","last_clean":"2024-09-16T16:56:54.169682+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:54.169682+0000","last_undegraded":"2024-09-16T16:56:54.169682+0000","last_fullsized":"2024-09-16T16:56:54.169682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'264","reported_seq":282,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:50.414332+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:50.414332+0000","last_peered":"2024-09-16T16:56:50.414332+0000","last_clean":"2024-09-16T16:56:50.414332+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:50.414332+0000","last_undegraded":"2024-09-16T16:56:50.414332+0000","last_fullsized":"2024-09-16T16:56:50.414332+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'368","reported_seq":386,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.749374+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:53.749374+0000","last_peered":"2024-09-16T16:56:53.749374+0000","last_clean":"2024-09-16T16:56:53.749374+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:53.749374+0000","last_undegraded":"2024-09-16T16:56:53.749374+0000","last_fullsized":"2024-09-16T16:56:53.749374+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'232","reported_seq":250,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:51.809784+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:51.809784+0000","last_peered":"2024-09-16T16:56:51.809784+0000","last_clean":"2024-09-16T16:56:51.809784+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:51.809784+0000","last_undegraded":"2024-09-16T16:56:51.809784+0000","last_fullsized":"2024-09-16T16:56:51.809784+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.237093+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:54.237093+0000","last_peered":"2024-09-16T16:56:54.237093+0000","last_clean":"2024-09-16T16:56:54.237093+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:54.237093+0000","last_undegraded":"2024-09-16T16:56:54.237093+0000","last_fullsized":"2024-09-16T16:56:54.237093+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'288","reported_seq":306,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.331236+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:53.331236+0000","last_peered":"2024-09-16T16:56:53.331236+0000","last_clean":"2024-09-16T16:56:53.331236+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:53.331236+0000","last_undegraded":"2024-09-16T16:56:53.331236+0000","last_fullsized":"2024-09-16T16:56:53.331236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'280","reported_seq":298,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:47.071494+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:47.071494+0000","last_peered":"2024-09-16T16:56:47.071494+0000","last_clean":"2024-09-16T16:56:47.071494+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:47.071494+0000","last_undegraded":"2024-09-16T16:56:47.071494+0000","last_fullsized":"2024-09-16T16:56:47.071494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'238","reported_seq":256,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.379953+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:54.379953+0000","last_peered":"2024-09-16T16:56:54.379953+0000","last_clean":"2024-09-16T16:56:54.379953+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:54.379953+0000","last_undegraded":"2024-09-16T16:56:54.379953+0000","last_fullsized":"2024-09-16T16:56:54.379953+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1949696,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":1904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.505964+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:53.505964+0000","last_peered":"2024-09-16T16:56:53.505964+0000","last_clean":"2024-09-16T16:56:53.505964+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:53.505964+0000","last_undegraded":"2024-09-16T16:56:53.505964+0000","last_fullsized":"2024-09-16T16:56:53.505964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.302107+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:54.302107+0000","last_peered":"2024-09-16T16:56:54.302107+0000","last_clean":"2024-09-16T16:56:54.302107+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:54.302107+0000","last_undegraded":"2024-09-16T16:56:54.302107+0000","last_fullsized":"2024-09-16T16:56:54.302107+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.436459+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:53.436459+0000","last_peered":"2024-09-16T16:56:53.436459+0000","last_clean":"2024-09-16T16:56:53.436459+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:53.436459+0000","last_undegraded":"2024-09-16T16:56:53.436459+0000","last_fullsized":"2024-09-16T16:56:53.436459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.099186+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:54.099186+0000","last_peered":"2024-09-16T16:56:54.099186+0000","last_clean":"2024-09-16T16:56:54.099186+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:54.099186+0000","last_undegraded":"2024-09-16T16:56:54.099186+0000","last_fullsized":"2024-09-16T16:56:54.099186+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":39370752,"num_objects":601,"num_object_clones":0,"num_object_copies":1803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4806,"num_write_kb":38448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959663616,"internally_reserved":0,"allocated":251830272,"data_stored":251830272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4806,"ondisk_log_size":4806,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959671808,"internally_reserved":0,"allocated":251822080,"data_stored":251822080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61280,"kb_used_data":61280,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236448,"statfs":{"total":53552873472,"available":53490122752,"internally_reserved":0,"allocated":62750720,"data_stored":62750720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":44952,"kb_used_data":44952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52252776,"statfs":{"total":53552873472,"available":53506842624,"internally_reserved":0,"allocated":46030848,"data_stored":46030848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":69840,"kb_used_data":69840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52227888,"statfs":{"total":53552873472,"available":53481357312,"internally_reserved":0,"allocated":71516160,"data_stored":71516160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65980,"kb_used_data":65980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231748,"statfs":{"total":53552873472,"available":53485309952,"internally_reserved":0,"allocated":67563520,"data_stored":67563520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53488963584,"internally_reserved":0,"allocated":63909888,"data_stored":63909888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:13.306 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 6642 6626 0.784249 0.773438 0.286769 0.159169 2024-09-16T16:57:14.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:14.208+0000 7fe9c2afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:14.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:14.217+0000 7fe9c2afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:14.306 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 6736 6720 0.783504 0.734375 0.104579 0.159323 2024-09-16T16:57:15.306 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 6843 6827 0.784274 0.835938 0.128331 0.15925 2024-09-16T16:57:16.306 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 16 6929 6913 0.782644 0.671875 0.179727 0.159537 2024-09-16T16:57:16.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:16.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:16.587+0000 7f067de5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:16.596+0000 7f067de5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:17.306 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 7011 6995 0.780614 0.640625 0.0889445 0.159859 2024-09-16T16:57:18.275 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:18.275 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:18.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:18.306 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 7110 7094 0.780508 0.773438 0.0990536 0.159959 2024-09-16T16:57:18.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:18.436+0000 7f2466108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:18.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:18.451+0000 7f2466108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:18.826 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:18.827 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:18.843 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-16T16:57:18.484251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":39961139,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4887,"num_write_kb":39556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4861,"ondisk_log_size":4861,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":242052,"kb_used_data":242052,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208948860,"statfs":{"total":214211493888,"available":213963632640,"internally_reserved":0,"allocated":247861248,"data_stored":247861248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002276"},"pg_stats":[{"pgid":"8.7","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.832939+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:56:53.832939+0000","last_peered":"2024-09-16T16:56:53.832939+0000","last_clean":"2024-09-16T16:56:53.832939+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:56:53.832939+0000","last_undegraded":"2024-09-16T16:56:53.832939+0000","last_fullsized":"2024-09-16T16:56:53.832939+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'240","reported_seq":258,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.949095+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:56:53.949095+0000","last_peered":"2024-09-16T16:56:53.949095+0000","last_clean":"2024-09-16T16:56:53.949095+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:56:53.949095+0000","last_undegraded":"2024-09-16T16:56:53.949095+0000","last_fullsized":"2024-09-16T16:56:53.949095+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:52.985595+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:56:52.985595+0000","last_peered":"2024-09-16T16:56:52.985595+0000","last_clean":"2024-09-16T16:56:52.985595+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:56:52.985595+0000","last_undegraded":"2024-09-16T16:56:52.985595+0000","last_fullsized":"2024-09-16T16:56:52.985595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'336","reported_seq":354,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.037581+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:56:54.037581+0000","last_peered":"2024-09-16T16:56:54.037581+0000","last_clean":"2024-09-16T16:56:54.037581+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:56:54.037581+0000","last_undegraded":"2024-09-16T16:56:54.037581+0000","last_fullsized":"2024-09-16T16:56:54.037581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'304","reported_seq":322,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.169682+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:56:54.169682+0000","last_peered":"2024-09-16T16:56:54.169682+0000","last_clean":"2024-09-16T16:56:54.169682+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:56:54.169682+0000","last_undegraded":"2024-09-16T16:56:54.169682+0000","last_fullsized":"2024-09-16T16:56:54.169682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'264","reported_seq":282,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:50.414332+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:56:50.414332+0000","last_peered":"2024-09-16T16:56:50.414332+0000","last_clean":"2024-09-16T16:56:50.414332+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:56:50.414332+0000","last_undegraded":"2024-09-16T16:56:50.414332+0000","last_fullsized":"2024-09-16T16:56:50.414332+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'368","reported_seq":386,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.749374+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:56:53.749374+0000","last_peered":"2024-09-16T16:56:53.749374+0000","last_clean":"2024-09-16T16:56:53.749374+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:56:53.749374+0000","last_undegraded":"2024-09-16T16:56:53.749374+0000","last_fullsized":"2024-09-16T16:56:53.749374+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'232","reported_seq":250,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:51.809784+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:56:51.809784+0000","last_peered":"2024-09-16T16:56:51.809784+0000","last_clean":"2024-09-16T16:56:51.809784+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:56:51.809784+0000","last_undegraded":"2024-09-16T16:56:51.809784+0000","last_fullsized":"2024-09-16T16:56:51.809784+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.237093+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:56:54.237093+0000","last_peered":"2024-09-16T16:56:54.237093+0000","last_clean":"2024-09-16T16:56:54.237093+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:56:54.237093+0000","last_undegraded":"2024-09-16T16:56:54.237093+0000","last_fullsized":"2024-09-16T16:56:54.237093+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'288","reported_seq":306,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.331236+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:56:53.331236+0000","last_peered":"2024-09-16T16:56:53.331236+0000","last_clean":"2024-09-16T16:56:53.331236+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:56:53.331236+0000","last_undegraded":"2024-09-16T16:56:53.331236+0000","last_fullsized":"2024-09-16T16:56:53.331236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'280","reported_seq":298,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:47.071494+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:56:47.071494+0000","last_peered":"2024-09-16T16:56:47.071494+0000","last_clean":"2024-09-16T16:56:47.071494+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:56:47.071494+0000","last_undegraded":"2024-09-16T16:56:47.071494+0000","last_fullsized":"2024-09-16T16:56:47.071494+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'238","reported_seq":256,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.379953+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:56:54.379953+0000","last_peered":"2024-09-16T16:56:54.379953+0000","last_clean":"2024-09-16T16:56:54.379953+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:56:54.379953+0000","last_undegraded":"2024-09-16T16:56:54.379953+0000","last_fullsized":"2024-09-16T16:56:54.379953+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1949696,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":1904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.505964+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:56:53.505964+0000","last_peered":"2024-09-16T16:56:53.505964+0000","last_clean":"2024-09-16T16:56:53.505964+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:56:53.505964+0000","last_undegraded":"2024-09-16T16:56:53.505964+0000","last_fullsized":"2024-09-16T16:56:53.505964+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'296","reported_seq":314,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.302107+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:56:54.302107+0000","last_peered":"2024-09-16T16:56:54.302107+0000","last_clean":"2024-09-16T16:56:54.302107+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:56:54.302107+0000","last_undegraded":"2024-09-16T16:56:54.302107+0000","last_fullsized":"2024-09-16T16:56:54.302107+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'352","reported_seq":370,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:53.436459+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:56:53.436459+0000","last_peered":"2024-09-16T16:56:53.436459+0000","last_clean":"2024-09-16T16:56:53.436459+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:56:53.436459+0000","last_undegraded":"2024-09-16T16:56:53.436459+0000","last_fullsized":"2024-09-16T16:56:53.436459+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'320","reported_seq":338,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:54.099186+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:56:54.099186+0000","last_peered":"2024-09-16T16:56:54.099186+0000","last_clean":"2024-09-16T16:56:54.099186+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:56:54.099186+0000","last_undegraded":"2024-09-16T16:56:54.099186+0000","last_fullsized":"2024-09-16T16:56:54.099186+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":39370752,"num_objects":601,"num_object_clones":0,"num_object_copies":1803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4806,"num_write_kb":38448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959663616,"internally_reserved":0,"allocated":251830272,"data_stored":251830272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4806,"ondisk_log_size":4806,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213959671808,"internally_reserved":0,"allocated":251822080,"data_stored":251822080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61280,"kb_used_data":61280,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236448,"statfs":{"total":53552873472,"available":53490122752,"internally_reserved":0,"allocated":62750720,"data_stored":62750720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":44952,"kb_used_data":44952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52252776,"statfs":{"total":53552873472,"available":53506842624,"internally_reserved":0,"allocated":46030848,"data_stored":46030848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":69840,"kb_used_data":69840,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52227888,"statfs":{"total":53552873472,"available":53481357312,"internally_reserved":0,"allocated":71516160,"data_stored":71516160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65980,"kb_used_data":65980,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231748,"statfs":{"total":53552873472,"available":53485309952,"internally_reserved":0,"allocated":67563520,"data_stored":67563520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53488971776,"internally_reserved":0,"allocated":63901696,"data_stored":63901696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53484507136,"internally_reserved":0,"allocated":68366336,"data_stored":68366336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53480136704,"internally_reserved":0,"allocated":72736768,"data_stored":72736768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53506056192,"internally_reserved":0,"allocated":46817280,"data_stored":46817280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53488963584,"internally_reserved":0,"allocated":63909888,"data_stored":63909888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:18.915 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:19.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:19.052+0000 7f1c3ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:19.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:19.060+0000 7f1c3ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:19.306 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7201 7185 0.77954 0.710938 0.151825 0.16012 2024-09-16T16:57:20.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 7309 7293 0.780419 0.84375 0.157682 0.159951 2024-09-16T16:57:21.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 7418 7402 0.781379 0.851562 0.178084 0.159745 2024-09-16T16:57:21.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:21.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:21.525+0000 7fcf0dcac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:21.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:21.534+0000 7fcf0dcac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:22.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 7517 7501 0.781272 0.773438 0.146989 0.159796 2024-09-16T16:57:23.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 7625 7609 0.782093 0.84375 0.123154 0.159668 2024-09-16T16:57:23.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:23.846 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:23.846 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:23.846 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:57:23.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:57:23.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:23.968+0000 7f381606c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:23.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:23.975+0000 7f381606c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.020+0000 7f14bdaa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.032+0000 7f14bdaa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.109 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:24.109 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:24.109 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:24.109 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:24.109 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:24.109 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:24.110 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:24.110 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:24.110 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:24.110 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:24.110 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:24.110 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:24.113 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:24.113 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:24.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:57:24.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 7707 7691 0.780255 0.640625 0.456131 0.159912 2024-09-16T16:57:24.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.298+0000 7fcea0e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.318+0000 7fcea0e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.356 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:24.356 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:24.356 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:24.356 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:24.356 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:24.357 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:24.362 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:24.362 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:24.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:57:24.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.564+0000 7f38b54bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.577+0000 7f38b54bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:24.597 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:24.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:24.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:24.598 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:24.598 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:24.602 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:24.602 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:24.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:57:24.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.724+0000 7eff51991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:24.736+0000 7eff51991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:57:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:57:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:57:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:57:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:57:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:57:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:57:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:57:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:57:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:57:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:57:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:57:24.838 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:57:24.838 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:57:25.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 7784 7768 0.777963 0.601562 0.293866 0.160381 2024-09-16T16:57:26.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 7871 7855 0.776719 0.679688 0.256542 0.160707 2024-09-16T16:57:26.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:26.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:26.501+0000 7f2e91ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:26.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:26.511+0000 7f2e91ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:27.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:57:27.307680+0000 min lat: 0.0225454 max lat: 1.183 avg lat: 0.160869 2024-09-16T16:57:27.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:57:27.308 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 7966 7950 0.776286 0.742188 0.121116 0.160869 2024-09-16T16:57:28.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 8067 8051 0.776443 0.789062 0.268673 0.160726 2024-09-16T16:57:28.931 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:29.064+0000 7f4902311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:29.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:29.073+0000 7f4902311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:29.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 16 8134 8118 0.773357 0.523438 0.0633206 0.161252 2024-09-16T16:57:29.838 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:29.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:29.839 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:29.959+0000 7f658c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:29.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:29.970+0000 7f658c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:30.175 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:30.175 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:30.188 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-16T16:57:28.486169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63775283,"num_objects":969,"num_object_clones":0,"num_object_copies":2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7794,"num_write_kb":62812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7768,"ondisk_log_size":7768,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":389272,"kb_used_data":389272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208801640,"statfs":{"total":214211493888,"available":213812879360,"internally_reserved":0,"allocated":398614528,"data_stored":398614528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23814144,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2907,"num_write_kb":23256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002250"},"pg_stats":[{"pgid":"8.7","version":"58'520","reported_seq":538,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.773379+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:57:23.773379+0000","last_peered":"2024-09-16T16:57:23.773379+0000","last_clean":"2024-09-16T16:57:23.773379+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:57:23.773379+0000","last_undegraded":"2024-09-16T16:57:23.773379+0000","last_fullsized":"2024-09-16T16:57:23.773379+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'360","reported_seq":378,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.710119+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:57:22.710119+0000","last_peered":"2024-09-16T16:57:22.710119+0000","last_clean":"2024-09-16T16:57:22.710119+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:57:22.710119+0000","last_undegraded":"2024-09-16T16:57:22.710119+0000","last_fullsized":"2024-09-16T16:57:22.710119+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.620256+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:57:22.620256+0000","last_peered":"2024-09-16T16:57:22.620256+0000","last_clean":"2024-09-16T16:57:22.620256+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:57:22.620256+0000","last_undegraded":"2024-09-16T16:57:22.620256+0000","last_fullsized":"2024-09-16T16:57:22.620256+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'472","reported_seq":490,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:21.270117+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:57:21.270117+0000","last_peered":"2024-09-16T16:57:21.270117+0000","last_clean":"2024-09-16T16:57:21.270117+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:57:21.270117+0000","last_undegraded":"2024-09-16T16:57:21.270117+0000","last_fullsized":"2024-09-16T16:57:21.270117+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.679150+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:57:23.679150+0000","last_peered":"2024-09-16T16:57:23.679150+0000","last_clean":"2024-09-16T16:57:23.679150+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:57:23.679150+0000","last_undegraded":"2024-09-16T16:57:23.679150+0000","last_fullsized":"2024-09-16T16:57:23.679150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'536","reported_seq":554,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.189072+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:57:24.189072+0000","last_peered":"2024-09-16T16:57:24.189072+0000","last_clean":"2024-09-16T16:57:24.189072+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:57:24.189072+0000","last_undegraded":"2024-09-16T16:57:24.189072+0000","last_fullsized":"2024-09-16T16:57:24.189072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'497","reported_seq":515,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.376649+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:57:24.376649+0000","last_peered":"2024-09-16T16:57:24.376649+0000","last_clean":"2024-09-16T16:57:24.376649+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:57:24.376649+0000","last_undegraded":"2024-09-16T16:57:24.376649+0000","last_fullsized":"2024-09-16T16:57:24.376649+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4071424,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":3976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'464","reported_seq":482,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.044627+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:57:23.044627+0000","last_peered":"2024-09-16T16:57:23.044627+0000","last_clean":"2024-09-16T16:57:23.044627+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:57:23.044627+0000","last_undegraded":"2024-09-16T16:57:23.044627+0000","last_fullsized":"2024-09-16T16:57:23.044627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'488","reported_seq":506,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:20.496805+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:57:20.496805+0000","last_peered":"2024-09-16T16:57:20.496805+0000","last_clean":"2024-09-16T16:57:20.496805+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:57:20.496805+0000","last_undegraded":"2024-09-16T16:57:20.496805+0000","last_fullsized":"2024-09-16T16:57:20.496805+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'448","reported_seq":466,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.046762+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:57:22.046762+0000","last_peered":"2024-09-16T16:57:22.046762+0000","last_clean":"2024-09-16T16:57:22.046762+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:57:22.046762+0000","last_undegraded":"2024-09-16T16:57:22.046762+0000","last_fullsized":"2024-09-16T16:57:22.046762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'400","reported_seq":418,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.331766+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:57:22.331766+0000","last_peered":"2024-09-16T16:57:22.331766+0000","last_clean":"2024-09-16T16:57:22.331766+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:57:22.331766+0000","last_undegraded":"2024-09-16T16:57:22.331766+0000","last_fullsized":"2024-09-16T16:57:22.331766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'408","reported_seq":426,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.257046+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:57:24.257046+0000","last_peered":"2024-09-16T16:57:24.257046+0000","last_clean":"2024-09-16T16:57:24.257046+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:57:24.257046+0000","last_undegraded":"2024-09-16T16:57:24.257046+0000","last_fullsized":"2024-09-16T16:57:24.257046+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.416566+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:57:22.416566+0000","last_peered":"2024-09-16T16:57:22.416566+0000","last_clean":"2024-09-16T16:57:22.416566+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:57:22.416566+0000","last_undegraded":"2024-09-16T16:57:22.416566+0000","last_fullsized":"2024-09-16T16:57:22.416566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.170688+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:57:23.170688+0000","last_peered":"2024-09-16T16:57:23.170688+0000","last_clean":"2024-09-16T16:57:23.170688+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:57:23.170688+0000","last_undegraded":"2024-09-16T16:57:23.170688+0000","last_fullsized":"2024-09-16T16:57:23.170688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.533660+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:57:22.533660+0000","last_peered":"2024-09-16T16:57:22.533660+0000","last_clean":"2024-09-16T16:57:22.533660+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:57:22.533660+0000","last_undegraded":"2024-09-16T16:57:22.533660+0000","last_fullsized":"2024-09-16T16:57:22.533660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'528","reported_seq":546,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.892522+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:57:23.892522+0000","last_peered":"2024-09-16T16:57:23.892522+0000","last_clean":"2024-09-16T16:57:23.892522+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:57:23.892522+0000","last_undegraded":"2024-09-16T16:57:23.892522+0000","last_fullsized":"2024-09-16T16:57:23.892522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":63184896,"num_objects":965,"num_object_clones":0,"num_object_copies":2895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7713,"num_write_kb":61704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810315264,"internally_reserved":0,"allocated":401178624,"data_stored":401178624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7713,"ondisk_log_size":7713,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810331648,"internally_reserved":0,"allocated":401162240,"data_stored":401162240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":99704,"kb_used_data":99704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52198024,"statfs":{"total":53552873472,"available":53450776576,"internally_reserved":0,"allocated":102096896,"data_stored":102096896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":72580,"kb_used_data":72580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52225148,"statfs":{"total":53552873472,"available":53478551552,"internally_reserved":0,"allocated":74321920,"data_stored":74321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111392,"kb_used_data":111392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186336,"statfs":{"total":53552873472,"available":53438808064,"internally_reserved":0,"allocated":114065408,"data_stored":114065408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":105596,"kb_used_data":105596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52192132,"statfs":{"total":53552873472,"available":53444743168,"internally_reserved":0,"allocated":108130304,"data_stored":108130304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444079616,"internally_reserved":0,"allocated":108793856,"data_stored":108793856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53437816832,"internally_reserved":0,"allocated":115056640,"data_stored":115056640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53444071424,"internally_reserved":0,"allocated":108802048,"data_stored":108802048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53437808640,"internally_reserved":0,"allocated":115064832,"data_stored":115064832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:30.307 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 8229 8213 0.772981 0.742188 0.0660913 0.161453 2024-09-16T16:57:31.308 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 8316 8300 0.771869 0.679688 0.293051 0.161642 2024-09-16T16:57:31.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:31.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:31.675+0000 7f8823991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:31.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:31.682+0000 7f8823991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:32.308 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 8402 8386 0.770692 0.671875 0.107864 0.161987 2024-09-16T16:57:33.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 8492 8476 0.769906 0.703125 0.138454 0.162033 2024-09-16T16:57:33.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:34.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:34.039+0000 7effd4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:34.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:34.048+0000 7effd4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:34.308 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 8580 8564 0.768958 0.6875 0.086001 0.162312 2024-09-16T16:57:35.190 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:35.190 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:35.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:35.308 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 16 8670 8654 0.768209 0.703125 0.0968023 0.162406 2024-09-16T16:57:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:35.304+0000 7f313e05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:35.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:35.314+0000 7f313e05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:35.513 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:35.533 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-16T16:57:34.487260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63775283,"num_objects":969,"num_object_clones":0,"num_object_copies":2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7794,"num_write_kb":62812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7768,"ondisk_log_size":7768,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":389272,"kb_used_data":389272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208801640,"statfs":{"total":214211493888,"available":213812879360,"internally_reserved":0,"allocated":398614528,"data_stored":398614528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23814144,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2907,"num_write_kb":23256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002322"},"pg_stats":[{"pgid":"8.7","version":"58'520","reported_seq":538,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.773379+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:57:23.773379+0000","last_peered":"2024-09-16T16:57:23.773379+0000","last_clean":"2024-09-16T16:57:23.773379+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:57:23.773379+0000","last_undegraded":"2024-09-16T16:57:23.773379+0000","last_fullsized":"2024-09-16T16:57:23.773379+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'360","reported_seq":378,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.710119+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:57:22.710119+0000","last_peered":"2024-09-16T16:57:22.710119+0000","last_clean":"2024-09-16T16:57:22.710119+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:57:22.710119+0000","last_undegraded":"2024-09-16T16:57:22.710119+0000","last_fullsized":"2024-09-16T16:57:22.710119+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.620256+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:57:22.620256+0000","last_peered":"2024-09-16T16:57:22.620256+0000","last_clean":"2024-09-16T16:57:22.620256+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:57:22.620256+0000","last_undegraded":"2024-09-16T16:57:22.620256+0000","last_fullsized":"2024-09-16T16:57:22.620256+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'472","reported_seq":490,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:21.270117+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:57:21.270117+0000","last_peered":"2024-09-16T16:57:21.270117+0000","last_clean":"2024-09-16T16:57:21.270117+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:57:21.270117+0000","last_undegraded":"2024-09-16T16:57:21.270117+0000","last_fullsized":"2024-09-16T16:57:21.270117+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.679150+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:57:23.679150+0000","last_peered":"2024-09-16T16:57:23.679150+0000","last_clean":"2024-09-16T16:57:23.679150+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:57:23.679150+0000","last_undegraded":"2024-09-16T16:57:23.679150+0000","last_fullsized":"2024-09-16T16:57:23.679150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'536","reported_seq":554,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.189072+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:57:24.189072+0000","last_peered":"2024-09-16T16:57:24.189072+0000","last_clean":"2024-09-16T16:57:24.189072+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:57:24.189072+0000","last_undegraded":"2024-09-16T16:57:24.189072+0000","last_fullsized":"2024-09-16T16:57:24.189072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'497","reported_seq":515,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.376649+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:57:24.376649+0000","last_peered":"2024-09-16T16:57:24.376649+0000","last_clean":"2024-09-16T16:57:24.376649+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:57:24.376649+0000","last_undegraded":"2024-09-16T16:57:24.376649+0000","last_fullsized":"2024-09-16T16:57:24.376649+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4071424,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":3976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'464","reported_seq":482,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.044627+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:57:23.044627+0000","last_peered":"2024-09-16T16:57:23.044627+0000","last_clean":"2024-09-16T16:57:23.044627+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:57:23.044627+0000","last_undegraded":"2024-09-16T16:57:23.044627+0000","last_fullsized":"2024-09-16T16:57:23.044627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'488","reported_seq":506,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:20.496805+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:57:20.496805+0000","last_peered":"2024-09-16T16:57:20.496805+0000","last_clean":"2024-09-16T16:57:20.496805+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:57:20.496805+0000","last_undegraded":"2024-09-16T16:57:20.496805+0000","last_fullsized":"2024-09-16T16:57:20.496805+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'448","reported_seq":466,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.046762+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:57:22.046762+0000","last_peered":"2024-09-16T16:57:22.046762+0000","last_clean":"2024-09-16T16:57:22.046762+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:57:22.046762+0000","last_undegraded":"2024-09-16T16:57:22.046762+0000","last_fullsized":"2024-09-16T16:57:22.046762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'400","reported_seq":418,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.331766+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:57:22.331766+0000","last_peered":"2024-09-16T16:57:22.331766+0000","last_clean":"2024-09-16T16:57:22.331766+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:57:22.331766+0000","last_undegraded":"2024-09-16T16:57:22.331766+0000","last_fullsized":"2024-09-16T16:57:22.331766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'408","reported_seq":426,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.257046+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:57:24.257046+0000","last_peered":"2024-09-16T16:57:24.257046+0000","last_clean":"2024-09-16T16:57:24.257046+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:57:24.257046+0000","last_undegraded":"2024-09-16T16:57:24.257046+0000","last_fullsized":"2024-09-16T16:57:24.257046+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.416566+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:57:22.416566+0000","last_peered":"2024-09-16T16:57:22.416566+0000","last_clean":"2024-09-16T16:57:22.416566+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:57:22.416566+0000","last_undegraded":"2024-09-16T16:57:22.416566+0000","last_fullsized":"2024-09-16T16:57:22.416566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.170688+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:57:23.170688+0000","last_peered":"2024-09-16T16:57:23.170688+0000","last_clean":"2024-09-16T16:57:23.170688+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:57:23.170688+0000","last_undegraded":"2024-09-16T16:57:23.170688+0000","last_fullsized":"2024-09-16T16:57:23.170688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.533660+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:57:22.533660+0000","last_peered":"2024-09-16T16:57:22.533660+0000","last_clean":"2024-09-16T16:57:22.533660+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:57:22.533660+0000","last_undegraded":"2024-09-16T16:57:22.533660+0000","last_fullsized":"2024-09-16T16:57:22.533660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'528","reported_seq":546,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.892522+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:57:23.892522+0000","last_peered":"2024-09-16T16:57:23.892522+0000","last_clean":"2024-09-16T16:57:23.892522+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:57:23.892522+0000","last_undegraded":"2024-09-16T16:57:23.892522+0000","last_fullsized":"2024-09-16T16:57:23.892522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":63184896,"num_objects":965,"num_object_clones":0,"num_object_copies":2895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7713,"num_write_kb":61704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810315264,"internally_reserved":0,"allocated":401178624,"data_stored":401178624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7713,"ondisk_log_size":7713,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810331648,"internally_reserved":0,"allocated":401162240,"data_stored":401162240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":99704,"kb_used_data":99704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52198024,"statfs":{"total":53552873472,"available":53450776576,"internally_reserved":0,"allocated":102096896,"data_stored":102096896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":72580,"kb_used_data":72580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52225148,"statfs":{"total":53552873472,"available":53478551552,"internally_reserved":0,"allocated":74321920,"data_stored":74321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111392,"kb_used_data":111392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186336,"statfs":{"total":53552873472,"available":53438808064,"internally_reserved":0,"allocated":114065408,"data_stored":114065408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":105596,"kb_used_data":105596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52192132,"statfs":{"total":53552873472,"available":53444743168,"internally_reserved":0,"allocated":108130304,"data_stored":108130304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444079616,"internally_reserved":0,"allocated":108793856,"data_stored":108793856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53437816832,"internally_reserved":0,"allocated":115056640,"data_stored":115056640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53444071424,"internally_reserved":0,"allocated":108802048,"data_stored":108802048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53437808640,"internally_reserved":0,"allocated":115064832,"data_stored":115064832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:36.308 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 8762 8746 0.767652 0.71875 0.355342 0.162686 2024-09-16T16:57:36.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:36.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:36.541+0000 7f3e2db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:36.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:36.552+0000 7f3e2db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:37.308 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 16 8864 8848 0.767976 0.796875 0.33358 0.162592 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.197 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 8864 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.767764 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.106217 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 1.01562 2024-09-16T16:57:38.309 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.484375 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 98 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 13.5958 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 130 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 62 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.162647 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.095805 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 1.183 2024-09-16T16:57:38.310 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0225454 2024-09-16T16:57:38.352 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:57:38.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:39.050+0000 7f38f9663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:39.058+0000 7f38f9663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:40.535 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:40.535 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:40.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:40.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:40.661+0000 7feca2e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:40.674+0000 7feca2e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:41.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:41.074 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-16T16:57:40.488403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63775283,"num_objects":969,"num_object_clones":0,"num_object_copies":2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7794,"num_write_kb":62812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7768,"ondisk_log_size":7768,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":389272,"kb_used_data":389272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208801640,"statfs":{"total":214211493888,"available":213812879360,"internally_reserved":0,"allocated":398614528,"data_stored":398614528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002233"},"pg_stats":[{"pgid":"8.7","version":"58'520","reported_seq":538,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.773379+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:57:23.773379+0000","last_peered":"2024-09-16T16:57:23.773379+0000","last_clean":"2024-09-16T16:57:23.773379+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:57:23.773379+0000","last_undegraded":"2024-09-16T16:57:23.773379+0000","last_fullsized":"2024-09-16T16:57:23.773379+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'360","reported_seq":378,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.710119+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:57:22.710119+0000","last_peered":"2024-09-16T16:57:22.710119+0000","last_clean":"2024-09-16T16:57:22.710119+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:57:22.710119+0000","last_undegraded":"2024-09-16T16:57:22.710119+0000","last_fullsized":"2024-09-16T16:57:22.710119+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.620256+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:57:22.620256+0000","last_peered":"2024-09-16T16:57:22.620256+0000","last_clean":"2024-09-16T16:57:22.620256+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:57:22.620256+0000","last_undegraded":"2024-09-16T16:57:22.620256+0000","last_fullsized":"2024-09-16T16:57:22.620256+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'472","reported_seq":490,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:21.270117+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:57:21.270117+0000","last_peered":"2024-09-16T16:57:21.270117+0000","last_clean":"2024-09-16T16:57:21.270117+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:57:21.270117+0000","last_undegraded":"2024-09-16T16:57:21.270117+0000","last_fullsized":"2024-09-16T16:57:21.270117+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.679150+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:57:23.679150+0000","last_peered":"2024-09-16T16:57:23.679150+0000","last_clean":"2024-09-16T16:57:23.679150+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:57:23.679150+0000","last_undegraded":"2024-09-16T16:57:23.679150+0000","last_fullsized":"2024-09-16T16:57:23.679150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'536","reported_seq":554,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.189072+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:57:24.189072+0000","last_peered":"2024-09-16T16:57:24.189072+0000","last_clean":"2024-09-16T16:57:24.189072+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:57:24.189072+0000","last_undegraded":"2024-09-16T16:57:24.189072+0000","last_fullsized":"2024-09-16T16:57:24.189072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'497","reported_seq":515,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.376649+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:57:24.376649+0000","last_peered":"2024-09-16T16:57:24.376649+0000","last_clean":"2024-09-16T16:57:24.376649+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:57:24.376649+0000","last_undegraded":"2024-09-16T16:57:24.376649+0000","last_fullsized":"2024-09-16T16:57:24.376649+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4071424,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":3976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'464","reported_seq":482,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.044627+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:57:23.044627+0000","last_peered":"2024-09-16T16:57:23.044627+0000","last_clean":"2024-09-16T16:57:23.044627+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:57:23.044627+0000","last_undegraded":"2024-09-16T16:57:23.044627+0000","last_fullsized":"2024-09-16T16:57:23.044627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'488","reported_seq":506,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:20.496805+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:57:20.496805+0000","last_peered":"2024-09-16T16:57:20.496805+0000","last_clean":"2024-09-16T16:57:20.496805+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:57:20.496805+0000","last_undegraded":"2024-09-16T16:57:20.496805+0000","last_fullsized":"2024-09-16T16:57:20.496805+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'448","reported_seq":466,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.046762+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:57:22.046762+0000","last_peered":"2024-09-16T16:57:22.046762+0000","last_clean":"2024-09-16T16:57:22.046762+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:57:22.046762+0000","last_undegraded":"2024-09-16T16:57:22.046762+0000","last_fullsized":"2024-09-16T16:57:22.046762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'400","reported_seq":418,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.331766+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:57:22.331766+0000","last_peered":"2024-09-16T16:57:22.331766+0000","last_clean":"2024-09-16T16:57:22.331766+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:57:22.331766+0000","last_undegraded":"2024-09-16T16:57:22.331766+0000","last_fullsized":"2024-09-16T16:57:22.331766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'408","reported_seq":426,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.257046+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:57:24.257046+0000","last_peered":"2024-09-16T16:57:24.257046+0000","last_clean":"2024-09-16T16:57:24.257046+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:57:24.257046+0000","last_undegraded":"2024-09-16T16:57:24.257046+0000","last_fullsized":"2024-09-16T16:57:24.257046+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.416566+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:57:22.416566+0000","last_peered":"2024-09-16T16:57:22.416566+0000","last_clean":"2024-09-16T16:57:22.416566+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:57:22.416566+0000","last_undegraded":"2024-09-16T16:57:22.416566+0000","last_fullsized":"2024-09-16T16:57:22.416566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.170688+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:57:23.170688+0000","last_peered":"2024-09-16T16:57:23.170688+0000","last_clean":"2024-09-16T16:57:23.170688+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:57:23.170688+0000","last_undegraded":"2024-09-16T16:57:23.170688+0000","last_fullsized":"2024-09-16T16:57:23.170688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.533660+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:57:22.533660+0000","last_peered":"2024-09-16T16:57:22.533660+0000","last_clean":"2024-09-16T16:57:22.533660+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:57:22.533660+0000","last_undegraded":"2024-09-16T16:57:22.533660+0000","last_fullsized":"2024-09-16T16:57:22.533660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'528","reported_seq":546,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.892522+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:57:23.892522+0000","last_peered":"2024-09-16T16:57:23.892522+0000","last_clean":"2024-09-16T16:57:23.892522+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:57:23.892522+0000","last_undegraded":"2024-09-16T16:57:23.892522+0000","last_fullsized":"2024-09-16T16:57:23.892522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":63184896,"num_objects":965,"num_object_clones":0,"num_object_copies":2895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7713,"num_write_kb":61704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810315264,"internally_reserved":0,"allocated":401178624,"data_stored":401178624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7713,"ondisk_log_size":7713,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810331648,"internally_reserved":0,"allocated":401162240,"data_stored":401162240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":99704,"kb_used_data":99704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52198024,"statfs":{"total":53552873472,"available":53450776576,"internally_reserved":0,"allocated":102096896,"data_stored":102096896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":72580,"kb_used_data":72580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52225148,"statfs":{"total":53552873472,"available":53478551552,"internally_reserved":0,"allocated":74321920,"data_stored":74321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111392,"kb_used_data":111392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186336,"statfs":{"total":53552873472,"available":53438808064,"internally_reserved":0,"allocated":114065408,"data_stored":114065408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":105596,"kb_used_data":105596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52192132,"statfs":{"total":53552873472,"available":53444743168,"internally_reserved":0,"allocated":108130304,"data_stored":108130304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444079616,"internally_reserved":0,"allocated":108793856,"data_stored":108793856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53437816832,"internally_reserved":0,"allocated":115056640,"data_stored":115056640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53444071424,"internally_reserved":0,"allocated":108802048,"data_stored":108802048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53437808640,"internally_reserved":0,"allocated":115064832,"data_stored":115064832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:41.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:41.682+0000 7ffbb3551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:41.691+0000 7ffbb3551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:44.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:44.291+0000 7f7462874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:44.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:44.302+0000 7f7462874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.101 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:46.102 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:46.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:46.246+0000 7fae3ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:46.259+0000 7fae3ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:46.670 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-16T16:57:46.489493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63775283,"num_objects":969,"num_object_clones":0,"num_object_copies":2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7794,"num_write_kb":62812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7768,"ondisk_log_size":7768,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":389272,"kb_used_data":389272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208801640,"statfs":{"total":214211493888,"available":213812879360,"internally_reserved":0,"allocated":398614528,"data_stored":398614528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002233"},"pg_stats":[{"pgid":"8.7","version":"58'520","reported_seq":538,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.773379+0000","last_change":"2024-09-16T16:56:06.392306+0000","last_active":"2024-09-16T16:57:23.773379+0000","last_peered":"2024-09-16T16:57:23.773379+0000","last_clean":"2024-09-16T16:57:23.773379+0000","last_became_active":"2024-09-16T16:56:06.381974+0000","last_became_peered":"2024-09-16T16:56:06.381974+0000","last_unstale":"2024-09-16T16:57:23.773379+0000","last_undegraded":"2024-09-16T16:57:23.773379+0000","last_fullsized":"2024-09-16T16:57:23.773379+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'360","reported_seq":378,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.710119+0000","last_change":"2024-09-16T16:56:06.355020+0000","last_active":"2024-09-16T16:57:22.710119+0000","last_peered":"2024-09-16T16:57:22.710119+0000","last_clean":"2024-09-16T16:57:22.710119+0000","last_became_active":"2024-09-16T16:56:06.328809+0000","last_became_peered":"2024-09-16T16:56:06.328809+0000","last_unstale":"2024-09-16T16:57:22.710119+0000","last_undegraded":"2024-09-16T16:57:22.710119+0000","last_fullsized":"2024-09-16T16:57:22.710119+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.620256+0000","last_change":"2024-09-16T16:56:06.555410+0000","last_active":"2024-09-16T16:57:22.620256+0000","last_peered":"2024-09-16T16:57:22.620256+0000","last_clean":"2024-09-16T16:57:22.620256+0000","last_became_active":"2024-09-16T16:56:06.549235+0000","last_became_peered":"2024-09-16T16:56:06.549235+0000","last_unstale":"2024-09-16T16:57:22.620256+0000","last_undegraded":"2024-09-16T16:57:22.620256+0000","last_fullsized":"2024-09-16T16:57:22.620256+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"58'472","reported_seq":490,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:21.270117+0000","last_change":"2024-09-16T16:56:06.429164+0000","last_active":"2024-09-16T16:57:21.270117+0000","last_peered":"2024-09-16T16:57:21.270117+0000","last_clean":"2024-09-16T16:57:21.270117+0000","last_became_active":"2024-09-16T16:56:06.362283+0000","last_became_peered":"2024-09-16T16:56:06.362283+0000","last_unstale":"2024-09-16T16:57:21.270117+0000","last_undegraded":"2024-09-16T16:57:21.270117+0000","last_fullsized":"2024-09-16T16:57:21.270117+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.679150+0000","last_change":"2024-09-16T16:56:06.441258+0000","last_active":"2024-09-16T16:57:23.679150+0000","last_peered":"2024-09-16T16:57:23.679150+0000","last_clean":"2024-09-16T16:57:23.679150+0000","last_became_active":"2024-09-16T16:56:06.430600+0000","last_became_peered":"2024-09-16T16:56:06.430600+0000","last_unstale":"2024-09-16T16:57:23.679150+0000","last_undegraded":"2024-09-16T16:57:23.679150+0000","last_fullsized":"2024-09-16T16:57:23.679150+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"58'536","reported_seq":554,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.189072+0000","last_change":"2024-09-16T16:56:06.393095+0000","last_active":"2024-09-16T16:57:24.189072+0000","last_peered":"2024-09-16T16:57:24.189072+0000","last_clean":"2024-09-16T16:57:24.189072+0000","last_became_active":"2024-09-16T16:56:06.381001+0000","last_became_peered":"2024-09-16T16:56:06.381001+0000","last_unstale":"2024-09-16T16:57:24.189072+0000","last_undegraded":"2024-09-16T16:57:24.189072+0000","last_fullsized":"2024-09-16T16:57:24.189072+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"58'497","reported_seq":515,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.376649+0000","last_change":"2024-09-16T16:56:06.592928+0000","last_active":"2024-09-16T16:57:24.376649+0000","last_peered":"2024-09-16T16:57:24.376649+0000","last_clean":"2024-09-16T16:57:24.376649+0000","last_became_active":"2024-09-16T16:56:06.587113+0000","last_became_peered":"2024-09-16T16:56:06.587113+0000","last_unstale":"2024-09-16T16:57:24.376649+0000","last_undegraded":"2024-09-16T16:57:24.376649+0000","last_fullsized":"2024-09-16T16:57:24.376649+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4071424,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":3976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"58'464","reported_seq":482,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.044627+0000","last_change":"2024-09-16T16:56:06.362323+0000","last_active":"2024-09-16T16:57:23.044627+0000","last_peered":"2024-09-16T16:57:23.044627+0000","last_clean":"2024-09-16T16:57:23.044627+0000","last_became_active":"2024-09-16T16:56:06.345997+0000","last_became_peered":"2024-09-16T16:56:06.345997+0000","last_unstale":"2024-09-16T16:57:23.044627+0000","last_undegraded":"2024-09-16T16:57:23.044627+0000","last_fullsized":"2024-09-16T16:57:23.044627+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"58'488","reported_seq":506,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:20.496805+0000","last_change":"2024-09-16T16:56:06.465699+0000","last_active":"2024-09-16T16:57:20.496805+0000","last_peered":"2024-09-16T16:57:20.496805+0000","last_clean":"2024-09-16T16:57:20.496805+0000","last_became_active":"2024-09-16T16:56:06.446475+0000","last_became_peered":"2024-09-16T16:56:06.446475+0000","last_unstale":"2024-09-16T16:57:20.496805+0000","last_undegraded":"2024-09-16T16:57:20.496805+0000","last_fullsized":"2024-09-16T16:57:20.496805+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":214,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.583599+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:56:09.583599+0000","last_peered":"2024-09-16T16:56:09.583599+0000","last_clean":"2024-09-16T16:56:09.583599+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:56:09.583599+0000","last_undegraded":"2024-09-16T16:56:09.583599+0000","last_fullsized":"2024-09-16T16:56:09.583599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":140,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254259+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:56:09.254259+0000","last_peered":"2024-09-16T16:56:09.254259+0000","last_clean":"2024-09-16T16:56:09.254259+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:56:09.254259+0000","last_undegraded":"2024-09-16T16:56:09.254259+0000","last_fullsized":"2024-09-16T16:56:09.254259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"58'448","reported_seq":466,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.046762+0000","last_change":"2024-09-16T16:56:06.505537+0000","last_active":"2024-09-16T16:57:22.046762+0000","last_peered":"2024-09-16T16:57:22.046762+0000","last_clean":"2024-09-16T16:57:22.046762+0000","last_became_active":"2024-09-16T16:56:06.498046+0000","last_became_peered":"2024-09-16T16:56:06.498046+0000","last_unstale":"2024-09-16T16:57:22.046762+0000","last_undegraded":"2024-09-16T16:57:22.046762+0000","last_fullsized":"2024-09-16T16:57:22.046762+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.261754+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:56:09.261754+0000","last_peered":"2024-09-16T16:56:09.261754+0000","last_clean":"2024-09-16T16:56:09.261754+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:56:09.261754+0000","last_undegraded":"2024-09-16T16:56:09.261754+0000","last_fullsized":"2024-09-16T16:56:09.261754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"58'400","reported_seq":418,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.331766+0000","last_change":"2024-09-16T16:56:06.642823+0000","last_active":"2024-09-16T16:57:22.331766+0000","last_peered":"2024-09-16T16:57:22.331766+0000","last_clean":"2024-09-16T16:57:22.331766+0000","last_became_active":"2024-09-16T16:56:06.636562+0000","last_became_peered":"2024-09-16T16:56:06.636562+0000","last_unstale":"2024-09-16T16:57:22.331766+0000","last_undegraded":"2024-09-16T16:57:22.331766+0000","last_fullsized":"2024-09-16T16:57:22.331766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.246092+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:56:09.246092+0000","last_peered":"2024-09-16T16:56:09.246092+0000","last_clean":"2024-09-16T16:56:09.246092+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:56:09.246092+0000","last_undegraded":"2024-09-16T16:56:09.246092+0000","last_fullsized":"2024-09-16T16:56:09.246092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"58'408","reported_seq":426,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:24.257046+0000","last_change":"2024-09-16T16:56:06.518774+0000","last_active":"2024-09-16T16:57:24.257046+0000","last_peered":"2024-09-16T16:57:24.257046+0000","last_clean":"2024-09-16T16:57:24.257046+0000","last_became_active":"2024-09-16T16:56:06.511652+0000","last_became_peered":"2024-09-16T16:56:06.511652+0000","last_unstale":"2024-09-16T16:57:24.257046+0000","last_undegraded":"2024-09-16T16:57:24.257046+0000","last_fullsized":"2024-09-16T16:57:24.257046+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":141,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.253852+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:56:09.253852+0000","last_peered":"2024-09-16T16:56:09.253852+0000","last_clean":"2024-09-16T16:56:09.253852+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:56:09.253852+0000","last_undegraded":"2024-09-16T16:56:09.253852+0000","last_fullsized":"2024-09-16T16:56:09.253852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.416566+0000","last_change":"2024-09-16T16:56:06.490172+0000","last_active":"2024-09-16T16:57:22.416566+0000","last_peered":"2024-09-16T16:57:22.416566+0000","last_clean":"2024-09-16T16:57:22.416566+0000","last_became_active":"2024-09-16T16:56:06.477962+0000","last_became_peered":"2024-09-16T16:56:06.477962+0000","last_unstale":"2024-09-16T16:57:22.416566+0000","last_undegraded":"2024-09-16T16:57:22.416566+0000","last_fullsized":"2024-09-16T16:57:22.416566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.237250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:56:09.237250+0000","last_peered":"2024-09-16T16:56:09.237250+0000","last_clean":"2024-09-16T16:56:09.237250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:56:09.237250+0000","last_undegraded":"2024-09-16T16:56:09.237250+0000","last_fullsized":"2024-09-16T16:56:09.237250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'480","reported_seq":498,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.170688+0000","last_change":"2024-09-16T16:56:06.344394+0000","last_active":"2024-09-16T16:57:23.170688+0000","last_peered":"2024-09-16T16:57:23.170688+0000","last_clean":"2024-09-16T16:57:23.170688+0000","last_became_active":"2024-09-16T16:56:06.336674+0000","last_became_peered":"2024-09-16T16:56:06.336674+0000","last_unstale":"2024-09-16T16:57:23.170688+0000","last_undegraded":"2024-09-16T16:57:23.170688+0000","last_fullsized":"2024-09-16T16:57:23.170688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.588351+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:56:09.588351+0000","last_peered":"2024-09-16T16:56:09.588351+0000","last_clean":"2024-09-16T16:56:09.588351+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:56:09.588351+0000","last_undegraded":"2024-09-16T16:56:09.588351+0000","last_fullsized":"2024-09-16T16:56:09.588351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"58'576","reported_seq":594,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:22.533660+0000","last_change":"2024-09-16T16:56:06.473028+0000","last_active":"2024-09-16T16:57:22.533660+0000","last_peered":"2024-09-16T16:57:22.533660+0000","last_clean":"2024-09-16T16:57:22.533660+0000","last_became_active":"2024-09-16T16:56:06.451836+0000","last_became_peered":"2024-09-16T16:56:06.451836+0000","last_unstale":"2024-09-16T16:57:22.533660+0000","last_undegraded":"2024-09-16T16:57:22.533660+0000","last_fullsized":"2024-09-16T16:57:22.533660+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.235538+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:56:09.235538+0000","last_peered":"2024-09-16T16:56:09.235538+0000","last_clean":"2024-09-16T16:56:09.235538+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:56:09.235538+0000","last_undegraded":"2024-09-16T16:56:09.235538+0000","last_fullsized":"2024-09-16T16:56:09.235538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"58'528","reported_seq":546,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:57:23.892522+0000","last_change":"2024-09-16T16:56:06.373618+0000","last_active":"2024-09-16T16:57:23.892522+0000","last_peered":"2024-09-16T16:57:23.892522+0000","last_clean":"2024-09-16T16:57:23.892522+0000","last_became_active":"2024-09-16T16:56:06.356123+0000","last_became_peered":"2024-09-16T16:56:06.356123+0000","last_unstale":"2024-09-16T16:57:23.892522+0000","last_undegraded":"2024-09-16T16:57:23.892522+0000","last_fullsized":"2024-09-16T16:57:23.892522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:56:05.191744+0000","last_clean_scrub_stamp":"2024-09-16T16:56:05.191744+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T16:56:09.254958+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:56:09.254958+0000","last_peered":"2024-09-16T16:56:09.254958+0000","last_clean":"2024-09-16T16:56:09.254958+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:56:09.254958+0000","last_undegraded":"2024-09-16T16:56:09.254958+0000","last_fullsized":"2024-09-16T16:56:09.254958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":63184896,"num_objects":965,"num_object_clones":0,"num_object_copies":2895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7713,"num_write_kb":61704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810315264,"internally_reserved":0,"allocated":401178624,"data_stored":401178624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7713,"ondisk_log_size":7713,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213810331648,"internally_reserved":0,"allocated":401162240,"data_stored":401162240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":99704,"kb_used_data":99704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52198024,"statfs":{"total":53552873472,"available":53450776576,"internally_reserved":0,"allocated":102096896,"data_stored":102096896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":72580,"kb_used_data":72580,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52225148,"statfs":{"total":53552873472,"available":53478551552,"internally_reserved":0,"allocated":74321920,"data_stored":74321920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":111392,"kb_used_data":111392,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52186336,"statfs":{"total":53552873472,"available":53438808064,"internally_reserved":0,"allocated":114065408,"data_stored":114065408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":105596,"kb_used_data":105596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52192132,"statfs":{"total":53552873472,"available":53444743168,"internally_reserved":0,"allocated":108130304,"data_stored":108130304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53450047488,"internally_reserved":0,"allocated":102825984,"data_stored":102825984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53444079616,"internally_reserved":0,"allocated":108793856,"data_stored":108793856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53437816832,"internally_reserved":0,"allocated":115056640,"data_stored":115056640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":53552873472,"available":53444071424,"internally_reserved":0,"allocated":108802048,"data_stored":108802048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":53552873472,"available":53437808640,"internally_reserved":0,"allocated":115064832,"data_stored":115064832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":53552873472,"available":53478395904,"internally_reserved":0,"allocated":74477568,"data_stored":74477568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":53552873472,"available":53450039296,"internally_reserved":0,"allocated":102834176,"data_stored":102834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:46.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:46.986+0000 7eff2d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:46.994+0000 7eff2d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:49.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:49.505+0000 7f91e3948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:49.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:49.516+0000 7f91e3948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:50.537 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1108 objects 2024-09-16T16:57:50.537 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :12.1845 2024-09-16T16:57:50.949 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_5 2024-09-16T16:57:50.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2024-09-16T16:57:51.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.060+0000 7f346f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.074+0000 7f346f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.358 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_5' removed 2024-09-16T16:57:51.379 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:57:51.380 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:57:51.380 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_6 2024-09-16T16:57:51.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_6 16 2024-09-16T16:57:51.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.556+0000 7f0be3f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.574+0000 7f0be3f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.671 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:57:51.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:57:51.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.791+0000 7f24a8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.802+0000 7f24a8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.971+0000 7fdfd085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:51.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:51.978+0000 7fdfd085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_6' created 2024-09-16T16:57:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:57:52.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:57:52.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2024-09-16T16:57:52.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:52.531+0000 7f3844591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:52.543+0000 7f3844591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:52.568+0000 7fa8f98bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:52.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:52.583+0000 7fa8f98bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:53.363 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:57:53.363 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_6' 2024-09-16T16:57:53.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:57:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:53.557+0000 7f18bb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:53.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:53.577+0000 7f18bb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:54.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:54.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:54.200+0000 7f52a4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:54.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:54.206+0000 7f52a4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:54.370 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:57:54.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:57:54.390 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_6 bench 90 write' 2024-09-16T16:57:54.433 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:57:54.433 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:57:54.499 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:57:54.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:57:54.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_56026 2024-09-16T16:57:54.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:57:54.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:57:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:54.502+0000 7f5a89991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:54.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:54.514+0000 7f5a89991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:57:55.397 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:57:55.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:55.499 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 122 106 0.828077 0.828125 0.190364 0.135138 2024-09-16T16:57:55.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:55.564+0000 7f07e5646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:55.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:55.576+0000 7f07e5646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:55.921 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:55.921 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:55.944 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-16T16:57:55.375940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":10388,"kb_used_data":10388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209180524,"statfs":{"total":214211493888,"available":214200856576,"internally_reserved":0,"allocated":10637312,"data_stored":10637312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017434"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.617830+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:57:53.617830+0000","last_peered":"2024-09-16T16:57:53.617830+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:57:53.617830+0000","last_undegraded":"2024-09-16T16:57:53.617830+0000","last_fullsized":"2024-09-16T16:57:53.617830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.396371+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:57:54.396371+0000","last_peered":"2024-09-16T16:57:54.396371+0000","last_clean":"2024-09-16T16:57:54.396371+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:57:54.396371+0000","last_undegraded":"2024-09-16T16:57:54.396371+0000","last_fullsized":"2024-09-16T16:57:54.396371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.390298+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:57:54.390298+0000","last_peered":"2024-09-16T16:57:54.390298+0000","last_clean":"2024-09-16T16:57:54.390298+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:57:54.390298+0000","last_undegraded":"2024-09-16T16:57:54.390298+0000","last_fullsized":"2024-09-16T16:57:54.390298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.392654+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:57:54.392654+0000","last_peered":"2024-09-16T16:57:54.392654+0000","last_clean":"2024-09-16T16:57:54.392654+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:57:54.392654+0000","last_undegraded":"2024-09-16T16:57:54.392654+0000","last_fullsized":"2024-09-16T16:57:54.392654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393853+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:57:54.393853+0000","last_peered":"2024-09-16T16:57:54.393853+0000","last_clean":"2024-09-16T16:57:54.393853+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:57:54.393853+0000","last_undegraded":"2024-09-16T16:57:54.393853+0000","last_fullsized":"2024-09-16T16:57:54.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397123+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:57:54.397123+0000","last_peered":"2024-09-16T16:57:54.397123+0000","last_clean":"2024-09-16T16:57:54.397123+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:57:54.397123+0000","last_undegraded":"2024-09-16T16:57:54.397123+0000","last_fullsized":"2024-09-16T16:57:54.397123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.628845+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:57:53.628845+0000","last_peered":"2024-09-16T16:57:53.628845+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:57:53.628845+0000","last_undegraded":"2024-09-16T16:57:53.628845+0000","last_fullsized":"2024-09-16T16:57:53.628845+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.619341+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:57:53.619341+0000","last_peered":"2024-09-16T16:57:53.619341+0000","last_clean":"2024-09-16T16:57:53.619341+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:57:53.619341+0000","last_undegraded":"2024-09-16T16:57:53.619341+0000","last_fullsized":"2024-09-16T16:57:53.619341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389003+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:57:54.389003+0000","last_peered":"2024-09-16T16:57:54.389003+0000","last_clean":"2024-09-16T16:57:54.389003+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:57:54.389003+0000","last_undegraded":"2024-09-16T16:57:54.389003+0000","last_fullsized":"2024-09-16T16:57:54.389003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":226,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389643+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:54.389643+0000","last_peered":"2024-09-16T16:57:54.389643+0000","last_clean":"2024-09-16T16:57:54.389643+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:54.389643+0000","last_undegraded":"2024-09-16T16:57:54.389643+0000","last_fullsized":"2024-09-16T16:57:54.389643+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397547+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:54.397547+0000","last_peered":"2024-09-16T16:57:54.397547+0000","last_clean":"2024-09-16T16:57:54.397547+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:54.397547+0000","last_undegraded":"2024-09-16T16:57:54.397547+0000","last_fullsized":"2024-09-16T16:57:54.397547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.577071+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:57:53.577071+0000","last_peered":"2024-09-16T16:57:53.577071+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:57:53.577071+0000","last_undegraded":"2024-09-16T16:57:53.577071+0000","last_fullsized":"2024-09-16T16:57:53.577071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.429625+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:53.429625+0000","last_peered":"2024-09-16T16:57:53.429625+0000","last_clean":"2024-09-16T16:57:53.429625+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:53.429625+0000","last_undegraded":"2024-09-16T16:57:53.429625+0000","last_fullsized":"2024-09-16T16:57:53.429625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394975+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:57:54.394975+0000","last_peered":"2024-09-16T16:57:54.394975+0000","last_clean":"2024-09-16T16:57:54.394975+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:57:54.394975+0000","last_undegraded":"2024-09-16T16:57:54.394975+0000","last_fullsized":"2024-09-16T16:57:54.394975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391487+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:54.391487+0000","last_peered":"2024-09-16T16:57:54.391487+0000","last_clean":"2024-09-16T16:57:54.391487+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:54.391487+0000","last_undegraded":"2024-09-16T16:57:54.391487+0000","last_fullsized":"2024-09-16T16:57:54.391487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394527+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:57:54.394527+0000","last_peered":"2024-09-16T16:57:54.394527+0000","last_clean":"2024-09-16T16:57:54.394527+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:57:54.394527+0000","last_undegraded":"2024-09-16T16:57:54.394527+0000","last_fullsized":"2024-09-16T16:57:54.394527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.422632+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:53.422632+0000","last_peered":"2024-09-16T16:57:53.422632+0000","last_clean":"2024-09-16T16:57:53.422632+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:53.422632+0000","last_undegraded":"2024-09-16T16:57:53.422632+0000","last_fullsized":"2024-09-16T16:57:53.422632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.634424+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:57:53.634424+0000","last_peered":"2024-09-16T16:57:53.634424+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:57:53.634424+0000","last_undegraded":"2024-09-16T16:57:53.634424+0000","last_fullsized":"2024-09-16T16:57:53.634424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.402521+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:53.402521+0000","last_peered":"2024-09-16T16:57:53.402521+0000","last_clean":"2024-09-16T16:57:53.402521+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:53.402521+0000","last_undegraded":"2024-09-16T16:57:53.402521+0000","last_fullsized":"2024-09-16T16:57:53.402521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.569471+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:57:53.569471+0000","last_peered":"2024-09-16T16:57:53.569471+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:57:53.569471+0000","last_undegraded":"2024-09-16T16:57:53.569471+0000","last_fullsized":"2024-09-16T16:57:53.569471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391729+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:54.391729+0000","last_peered":"2024-09-16T16:57:54.391729+0000","last_clean":"2024-09-16T16:57:54.391729+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:54.391729+0000","last_undegraded":"2024-09-16T16:57:54.391729+0000","last_fullsized":"2024-09-16T16:57:54.391729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391534+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:57:54.391534+0000","last_peered":"2024-09-16T16:57:54.391534+0000","last_clean":"2024-09-16T16:57:54.391534+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:57:54.391534+0000","last_undegraded":"2024-09-16T16:57:54.391534+0000","last_fullsized":"2024-09-16T16:57:54.391534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393008+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:54.393008+0000","last_peered":"2024-09-16T16:57:54.393008+0000","last_clean":"2024-09-16T16:57:54.393008+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:54.393008+0000","last_undegraded":"2024-09-16T16:57:54.393008+0000","last_fullsized":"2024-09-16T16:57:54.393008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395686+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:57:54.395686+0000","last_peered":"2024-09-16T16:57:54.395686+0000","last_clean":"2024-09-16T16:57:54.395686+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:57:54.395686+0000","last_undegraded":"2024-09-16T16:57:54.395686+0000","last_fullsized":"2024-09-16T16:57:54.395686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395382+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:54.395382+0000","last_peered":"2024-09-16T16:57:54.395382+0000","last_clean":"2024-09-16T16:57:54.395382+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:54.395382+0000","last_undegraded":"2024-09-16T16:57:54.395382+0000","last_fullsized":"2024-09-16T16:57:54.395382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2724,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295004,"statfs":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2780,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294948,"statfs":{"total":53552873472,"available":53550026752,"internally_reserved":0,"allocated":2846720,"data_stored":2846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1828,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295900,"statfs":{"total":53552873472,"available":53551001600,"internally_reserved":0,"allocated":1871872,"data_stored":1871872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3056,"kb_used_data":3056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294672,"statfs":{"total":53552873472,"available":53549744128,"internally_reserved":0,"allocated":3129344,"data_stored":3129344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:55.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:56.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:56.109+0000 7f20bcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:56.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:56.121+0000 7f20bcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:56.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:57:56.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:56.388 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:56.408 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-16T16:57:55.375940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":10388,"kb_used_data":10388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209180524,"statfs":{"total":214211493888,"available":214200856576,"internally_reserved":0,"allocated":10637312,"data_stored":10637312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017434"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.617830+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:57:53.617830+0000","last_peered":"2024-09-16T16:57:53.617830+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:57:53.617830+0000","last_undegraded":"2024-09-16T16:57:53.617830+0000","last_fullsized":"2024-09-16T16:57:53.617830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.396371+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:57:54.396371+0000","last_peered":"2024-09-16T16:57:54.396371+0000","last_clean":"2024-09-16T16:57:54.396371+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:57:54.396371+0000","last_undegraded":"2024-09-16T16:57:54.396371+0000","last_fullsized":"2024-09-16T16:57:54.396371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.390298+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:57:54.390298+0000","last_peered":"2024-09-16T16:57:54.390298+0000","last_clean":"2024-09-16T16:57:54.390298+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:57:54.390298+0000","last_undegraded":"2024-09-16T16:57:54.390298+0000","last_fullsized":"2024-09-16T16:57:54.390298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.392654+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:57:54.392654+0000","last_peered":"2024-09-16T16:57:54.392654+0000","last_clean":"2024-09-16T16:57:54.392654+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:57:54.392654+0000","last_undegraded":"2024-09-16T16:57:54.392654+0000","last_fullsized":"2024-09-16T16:57:54.392654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393853+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:57:54.393853+0000","last_peered":"2024-09-16T16:57:54.393853+0000","last_clean":"2024-09-16T16:57:54.393853+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:57:54.393853+0000","last_undegraded":"2024-09-16T16:57:54.393853+0000","last_fullsized":"2024-09-16T16:57:54.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397123+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:57:54.397123+0000","last_peered":"2024-09-16T16:57:54.397123+0000","last_clean":"2024-09-16T16:57:54.397123+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:57:54.397123+0000","last_undegraded":"2024-09-16T16:57:54.397123+0000","last_fullsized":"2024-09-16T16:57:54.397123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.628845+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:57:53.628845+0000","last_peered":"2024-09-16T16:57:53.628845+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:57:53.628845+0000","last_undegraded":"2024-09-16T16:57:53.628845+0000","last_fullsized":"2024-09-16T16:57:53.628845+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.619341+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:57:53.619341+0000","last_peered":"2024-09-16T16:57:53.619341+0000","last_clean":"2024-09-16T16:57:53.619341+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:57:53.619341+0000","last_undegraded":"2024-09-16T16:57:53.619341+0000","last_fullsized":"2024-09-16T16:57:53.619341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389003+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:57:54.389003+0000","last_peered":"2024-09-16T16:57:54.389003+0000","last_clean":"2024-09-16T16:57:54.389003+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:57:54.389003+0000","last_undegraded":"2024-09-16T16:57:54.389003+0000","last_fullsized":"2024-09-16T16:57:54.389003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":226,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389643+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:54.389643+0000","last_peered":"2024-09-16T16:57:54.389643+0000","last_clean":"2024-09-16T16:57:54.389643+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:54.389643+0000","last_undegraded":"2024-09-16T16:57:54.389643+0000","last_fullsized":"2024-09-16T16:57:54.389643+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397547+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:54.397547+0000","last_peered":"2024-09-16T16:57:54.397547+0000","last_clean":"2024-09-16T16:57:54.397547+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:54.397547+0000","last_undegraded":"2024-09-16T16:57:54.397547+0000","last_fullsized":"2024-09-16T16:57:54.397547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.577071+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:57:53.577071+0000","last_peered":"2024-09-16T16:57:53.577071+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:57:53.577071+0000","last_undegraded":"2024-09-16T16:57:53.577071+0000","last_fullsized":"2024-09-16T16:57:53.577071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.429625+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:53.429625+0000","last_peered":"2024-09-16T16:57:53.429625+0000","last_clean":"2024-09-16T16:57:53.429625+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:53.429625+0000","last_undegraded":"2024-09-16T16:57:53.429625+0000","last_fullsized":"2024-09-16T16:57:53.429625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394975+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:57:54.394975+0000","last_peered":"2024-09-16T16:57:54.394975+0000","last_clean":"2024-09-16T16:57:54.394975+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:57:54.394975+0000","last_undegraded":"2024-09-16T16:57:54.394975+0000","last_fullsized":"2024-09-16T16:57:54.394975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391487+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:54.391487+0000","last_peered":"2024-09-16T16:57:54.391487+0000","last_clean":"2024-09-16T16:57:54.391487+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:54.391487+0000","last_undegraded":"2024-09-16T16:57:54.391487+0000","last_fullsized":"2024-09-16T16:57:54.391487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394527+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:57:54.394527+0000","last_peered":"2024-09-16T16:57:54.394527+0000","last_clean":"2024-09-16T16:57:54.394527+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:57:54.394527+0000","last_undegraded":"2024-09-16T16:57:54.394527+0000","last_fullsized":"2024-09-16T16:57:54.394527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.422632+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:53.422632+0000","last_peered":"2024-09-16T16:57:53.422632+0000","last_clean":"2024-09-16T16:57:53.422632+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:53.422632+0000","last_undegraded":"2024-09-16T16:57:53.422632+0000","last_fullsized":"2024-09-16T16:57:53.422632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.634424+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:57:53.634424+0000","last_peered":"2024-09-16T16:57:53.634424+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:57:53.634424+0000","last_undegraded":"2024-09-16T16:57:53.634424+0000","last_fullsized":"2024-09-16T16:57:53.634424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.402521+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:53.402521+0000","last_peered":"2024-09-16T16:57:53.402521+0000","last_clean":"2024-09-16T16:57:53.402521+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:53.402521+0000","last_undegraded":"2024-09-16T16:57:53.402521+0000","last_fullsized":"2024-09-16T16:57:53.402521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.569471+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:57:53.569471+0000","last_peered":"2024-09-16T16:57:53.569471+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:57:53.569471+0000","last_undegraded":"2024-09-16T16:57:53.569471+0000","last_fullsized":"2024-09-16T16:57:53.569471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391729+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:54.391729+0000","last_peered":"2024-09-16T16:57:54.391729+0000","last_clean":"2024-09-16T16:57:54.391729+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:54.391729+0000","last_undegraded":"2024-09-16T16:57:54.391729+0000","last_fullsized":"2024-09-16T16:57:54.391729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391534+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:57:54.391534+0000","last_peered":"2024-09-16T16:57:54.391534+0000","last_clean":"2024-09-16T16:57:54.391534+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:57:54.391534+0000","last_undegraded":"2024-09-16T16:57:54.391534+0000","last_fullsized":"2024-09-16T16:57:54.391534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393008+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:54.393008+0000","last_peered":"2024-09-16T16:57:54.393008+0000","last_clean":"2024-09-16T16:57:54.393008+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:54.393008+0000","last_undegraded":"2024-09-16T16:57:54.393008+0000","last_fullsized":"2024-09-16T16:57:54.393008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395686+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:57:54.395686+0000","last_peered":"2024-09-16T16:57:54.395686+0000","last_clean":"2024-09-16T16:57:54.395686+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:57:54.395686+0000","last_undegraded":"2024-09-16T16:57:54.395686+0000","last_fullsized":"2024-09-16T16:57:54.395686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395382+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:54.395382+0000","last_peered":"2024-09-16T16:57:54.395382+0000","last_clean":"2024-09-16T16:57:54.395382+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:54.395382+0000","last_undegraded":"2024-09-16T16:57:54.395382+0000","last_fullsized":"2024-09-16T16:57:54.395382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2724,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295004,"statfs":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2780,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294948,"statfs":{"total":53552873472,"available":53550026752,"internally_reserved":0,"allocated":2846720,"data_stored":2846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1828,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295900,"statfs":{"total":53552873472,"available":53551001600,"internally_reserved":0,"allocated":1871872,"data_stored":1871872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3056,"kb_used_data":3056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294672,"statfs":{"total":53552873472,"available":53549744128,"internally_reserved":0,"allocated":3129344,"data_stored":3129344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:56.410 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:57:56.410 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:57:56.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:57:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:56.433+0000 7f78f64bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:56.442+0000 7f78f64bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:56.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 230 214 0.835872 0.84375 0.033296 0.140144 2024-09-16T16:57:56.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:56.553+0000 7f5ef5aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:56.566+0000 7f5ef5aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:57:56.794 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:57:56.812 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-09-16T16:57:56.491467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":10388,"kb_used_data":10388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209180524,"statfs":{"total":214211493888,"available":214200856576,"internally_reserved":0,"allocated":10637312,"data_stored":10637312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.128799"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.617830+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:57:53.617830+0000","last_peered":"2024-09-16T16:57:53.617830+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:57:53.617830+0000","last_undegraded":"2024-09-16T16:57:53.617830+0000","last_fullsized":"2024-09-16T16:57:53.617830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.396371+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:57:54.396371+0000","last_peered":"2024-09-16T16:57:54.396371+0000","last_clean":"2024-09-16T16:57:54.396371+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:57:54.396371+0000","last_undegraded":"2024-09-16T16:57:54.396371+0000","last_fullsized":"2024-09-16T16:57:54.396371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.390298+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:57:54.390298+0000","last_peered":"2024-09-16T16:57:54.390298+0000","last_clean":"2024-09-16T16:57:54.390298+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:57:54.390298+0000","last_undegraded":"2024-09-16T16:57:54.390298+0000","last_fullsized":"2024-09-16T16:57:54.390298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.392654+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:57:54.392654+0000","last_peered":"2024-09-16T16:57:54.392654+0000","last_clean":"2024-09-16T16:57:54.392654+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:57:54.392654+0000","last_undegraded":"2024-09-16T16:57:54.392654+0000","last_fullsized":"2024-09-16T16:57:54.392654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393853+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:57:54.393853+0000","last_peered":"2024-09-16T16:57:54.393853+0000","last_clean":"2024-09-16T16:57:54.393853+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:57:54.393853+0000","last_undegraded":"2024-09-16T16:57:54.393853+0000","last_fullsized":"2024-09-16T16:57:54.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397123+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:57:54.397123+0000","last_peered":"2024-09-16T16:57:54.397123+0000","last_clean":"2024-09-16T16:57:54.397123+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:57:54.397123+0000","last_undegraded":"2024-09-16T16:57:54.397123+0000","last_fullsized":"2024-09-16T16:57:54.397123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.628845+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:57:53.628845+0000","last_peered":"2024-09-16T16:57:53.628845+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:57:53.628845+0000","last_undegraded":"2024-09-16T16:57:53.628845+0000","last_fullsized":"2024-09-16T16:57:53.628845+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.619341+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:57:53.619341+0000","last_peered":"2024-09-16T16:57:53.619341+0000","last_clean":"2024-09-16T16:57:53.619341+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:57:53.619341+0000","last_undegraded":"2024-09-16T16:57:53.619341+0000","last_fullsized":"2024-09-16T16:57:53.619341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389003+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:57:54.389003+0000","last_peered":"2024-09-16T16:57:54.389003+0000","last_clean":"2024-09-16T16:57:54.389003+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:57:54.389003+0000","last_undegraded":"2024-09-16T16:57:54.389003+0000","last_fullsized":"2024-09-16T16:57:54.389003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":226,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389643+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:54.389643+0000","last_peered":"2024-09-16T16:57:54.389643+0000","last_clean":"2024-09-16T16:57:54.389643+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:54.389643+0000","last_undegraded":"2024-09-16T16:57:54.389643+0000","last_fullsized":"2024-09-16T16:57:54.389643+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397547+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:54.397547+0000","last_peered":"2024-09-16T16:57:54.397547+0000","last_clean":"2024-09-16T16:57:54.397547+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:54.397547+0000","last_undegraded":"2024-09-16T16:57:54.397547+0000","last_fullsized":"2024-09-16T16:57:54.397547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.577071+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:57:53.577071+0000","last_peered":"2024-09-16T16:57:53.577071+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:57:53.577071+0000","last_undegraded":"2024-09-16T16:57:53.577071+0000","last_fullsized":"2024-09-16T16:57:53.577071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.429625+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:53.429625+0000","last_peered":"2024-09-16T16:57:53.429625+0000","last_clean":"2024-09-16T16:57:53.429625+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:53.429625+0000","last_undegraded":"2024-09-16T16:57:53.429625+0000","last_fullsized":"2024-09-16T16:57:53.429625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394975+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:57:54.394975+0000","last_peered":"2024-09-16T16:57:54.394975+0000","last_clean":"2024-09-16T16:57:54.394975+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:57:54.394975+0000","last_undegraded":"2024-09-16T16:57:54.394975+0000","last_fullsized":"2024-09-16T16:57:54.394975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391487+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:54.391487+0000","last_peered":"2024-09-16T16:57:54.391487+0000","last_clean":"2024-09-16T16:57:54.391487+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:54.391487+0000","last_undegraded":"2024-09-16T16:57:54.391487+0000","last_fullsized":"2024-09-16T16:57:54.391487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394527+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:57:54.394527+0000","last_peered":"2024-09-16T16:57:54.394527+0000","last_clean":"2024-09-16T16:57:54.394527+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:57:54.394527+0000","last_undegraded":"2024-09-16T16:57:54.394527+0000","last_fullsized":"2024-09-16T16:57:54.394527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.422632+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:53.422632+0000","last_peered":"2024-09-16T16:57:53.422632+0000","last_clean":"2024-09-16T16:57:53.422632+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:53.422632+0000","last_undegraded":"2024-09-16T16:57:53.422632+0000","last_fullsized":"2024-09-16T16:57:53.422632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.634424+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:57:53.634424+0000","last_peered":"2024-09-16T16:57:53.634424+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:57:53.634424+0000","last_undegraded":"2024-09-16T16:57:53.634424+0000","last_fullsized":"2024-09-16T16:57:53.634424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.402521+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:53.402521+0000","last_peered":"2024-09-16T16:57:53.402521+0000","last_clean":"2024-09-16T16:57:53.402521+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:53.402521+0000","last_undegraded":"2024-09-16T16:57:53.402521+0000","last_fullsized":"2024-09-16T16:57:53.402521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.569471+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:57:53.569471+0000","last_peered":"2024-09-16T16:57:53.569471+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:57:53.569471+0000","last_undegraded":"2024-09-16T16:57:53.569471+0000","last_fullsized":"2024-09-16T16:57:53.569471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391729+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:54.391729+0000","last_peered":"2024-09-16T16:57:54.391729+0000","last_clean":"2024-09-16T16:57:54.391729+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:54.391729+0000","last_undegraded":"2024-09-16T16:57:54.391729+0000","last_fullsized":"2024-09-16T16:57:54.391729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391534+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:57:54.391534+0000","last_peered":"2024-09-16T16:57:54.391534+0000","last_clean":"2024-09-16T16:57:54.391534+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:57:54.391534+0000","last_undegraded":"2024-09-16T16:57:54.391534+0000","last_fullsized":"2024-09-16T16:57:54.391534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393008+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:54.393008+0000","last_peered":"2024-09-16T16:57:54.393008+0000","last_clean":"2024-09-16T16:57:54.393008+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:54.393008+0000","last_undegraded":"2024-09-16T16:57:54.393008+0000","last_fullsized":"2024-09-16T16:57:54.393008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395686+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:57:54.395686+0000","last_peered":"2024-09-16T16:57:54.395686+0000","last_clean":"2024-09-16T16:57:54.395686+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:57:54.395686+0000","last_undegraded":"2024-09-16T16:57:54.395686+0000","last_fullsized":"2024-09-16T16:57:54.395686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395382+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:54.395382+0000","last_peered":"2024-09-16T16:57:54.395382+0000","last_clean":"2024-09-16T16:57:54.395382+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:54.395382+0000","last_undegraded":"2024-09-16T16:57:54.395382+0000","last_fullsized":"2024-09-16T16:57:54.395382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2724,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295004,"statfs":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2780,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294948,"statfs":{"total":53552873472,"available":53550026752,"internally_reserved":0,"allocated":2846720,"data_stored":2846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1828,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295900,"statfs":{"total":53552873472,"available":53551001600,"internally_reserved":0,"allocated":1871872,"data_stored":1871872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3056,"kb_used_data":3056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294672,"statfs":{"total":53552873472,"available":53549744128,"internally_reserved":0,"allocated":3129344,"data_stored":3129344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:57:57.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 330 314 0.817633 0.78125 0.128918 0.144997 2024-09-16T16:57:58.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 16 413 397 0.775317 0.648438 0.171164 0.153975 2024-09-16T16:57:58.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:57:58.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:58.801+0000 7fe052257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:58.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:57:58.809+0000 7fe052257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:57:59.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 523 507 0.792111 0.859375 0.231048 0.155376 2024-09-16T16:58:00.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 635 619 0.805912 0.875 0.113679 0.150527 2024-09-16T16:58:01.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:01.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:01.300+0000 7f5a8df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:01.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:01.309+0000 7f5a8df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:01.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 730 714 0.796799 0.742188 0.180334 0.152411 2024-09-16T16:58:01.814 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:01.815 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:01.815 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:01.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:01.935+0000 7ff985f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:01.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:01.945+0000 7ff985f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:02.147 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:58:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:58:02.160 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-16T16:58:00.492340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":10388,"kb_used_data":10388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209180524,"statfs":{"total":214211493888,"available":214200856576,"internally_reserved":0,"allocated":10637312,"data_stored":10637312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.128518"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.617830+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:57:53.617830+0000","last_peered":"2024-09-16T16:57:53.617830+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:57:53.617830+0000","last_undegraded":"2024-09-16T16:57:53.617830+0000","last_fullsized":"2024-09-16T16:57:53.617830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.396371+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:57:54.396371+0000","last_peered":"2024-09-16T16:57:54.396371+0000","last_clean":"2024-09-16T16:57:54.396371+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:57:54.396371+0000","last_undegraded":"2024-09-16T16:57:54.396371+0000","last_fullsized":"2024-09-16T16:57:54.396371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.390298+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:57:54.390298+0000","last_peered":"2024-09-16T16:57:54.390298+0000","last_clean":"2024-09-16T16:57:54.390298+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:57:54.390298+0000","last_undegraded":"2024-09-16T16:57:54.390298+0000","last_fullsized":"2024-09-16T16:57:54.390298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.392654+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:57:54.392654+0000","last_peered":"2024-09-16T16:57:54.392654+0000","last_clean":"2024-09-16T16:57:54.392654+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:57:54.392654+0000","last_undegraded":"2024-09-16T16:57:54.392654+0000","last_fullsized":"2024-09-16T16:57:54.392654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393853+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:57:54.393853+0000","last_peered":"2024-09-16T16:57:54.393853+0000","last_clean":"2024-09-16T16:57:54.393853+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:57:54.393853+0000","last_undegraded":"2024-09-16T16:57:54.393853+0000","last_fullsized":"2024-09-16T16:57:54.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397123+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:57:54.397123+0000","last_peered":"2024-09-16T16:57:54.397123+0000","last_clean":"2024-09-16T16:57:54.397123+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:57:54.397123+0000","last_undegraded":"2024-09-16T16:57:54.397123+0000","last_fullsized":"2024-09-16T16:57:54.397123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.628845+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:57:53.628845+0000","last_peered":"2024-09-16T16:57:53.628845+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:57:53.628845+0000","last_undegraded":"2024-09-16T16:57:53.628845+0000","last_fullsized":"2024-09-16T16:57:53.628845+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.619341+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:57:53.619341+0000","last_peered":"2024-09-16T16:57:53.619341+0000","last_clean":"2024-09-16T16:57:53.619341+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:57:53.619341+0000","last_undegraded":"2024-09-16T16:57:53.619341+0000","last_fullsized":"2024-09-16T16:57:53.619341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389003+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:57:54.389003+0000","last_peered":"2024-09-16T16:57:54.389003+0000","last_clean":"2024-09-16T16:57:54.389003+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:57:54.389003+0000","last_undegraded":"2024-09-16T16:57:54.389003+0000","last_fullsized":"2024-09-16T16:57:54.389003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":226,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389643+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:54.389643+0000","last_peered":"2024-09-16T16:57:54.389643+0000","last_clean":"2024-09-16T16:57:54.389643+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:54.389643+0000","last_undegraded":"2024-09-16T16:57:54.389643+0000","last_fullsized":"2024-09-16T16:57:54.389643+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397547+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:54.397547+0000","last_peered":"2024-09-16T16:57:54.397547+0000","last_clean":"2024-09-16T16:57:54.397547+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:54.397547+0000","last_undegraded":"2024-09-16T16:57:54.397547+0000","last_fullsized":"2024-09-16T16:57:54.397547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.577071+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:57:53.577071+0000","last_peered":"2024-09-16T16:57:53.577071+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:57:53.577071+0000","last_undegraded":"2024-09-16T16:57:53.577071+0000","last_fullsized":"2024-09-16T16:57:53.577071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.429625+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:53.429625+0000","last_peered":"2024-09-16T16:57:53.429625+0000","last_clean":"2024-09-16T16:57:53.429625+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:53.429625+0000","last_undegraded":"2024-09-16T16:57:53.429625+0000","last_fullsized":"2024-09-16T16:57:53.429625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394975+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:57:54.394975+0000","last_peered":"2024-09-16T16:57:54.394975+0000","last_clean":"2024-09-16T16:57:54.394975+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:57:54.394975+0000","last_undegraded":"2024-09-16T16:57:54.394975+0000","last_fullsized":"2024-09-16T16:57:54.394975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391487+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:54.391487+0000","last_peered":"2024-09-16T16:57:54.391487+0000","last_clean":"2024-09-16T16:57:54.391487+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:54.391487+0000","last_undegraded":"2024-09-16T16:57:54.391487+0000","last_fullsized":"2024-09-16T16:57:54.391487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394527+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:57:54.394527+0000","last_peered":"2024-09-16T16:57:54.394527+0000","last_clean":"2024-09-16T16:57:54.394527+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:57:54.394527+0000","last_undegraded":"2024-09-16T16:57:54.394527+0000","last_fullsized":"2024-09-16T16:57:54.394527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.422632+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:53.422632+0000","last_peered":"2024-09-16T16:57:53.422632+0000","last_clean":"2024-09-16T16:57:53.422632+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:53.422632+0000","last_undegraded":"2024-09-16T16:57:53.422632+0000","last_fullsized":"2024-09-16T16:57:53.422632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.634424+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:57:53.634424+0000","last_peered":"2024-09-16T16:57:53.634424+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:57:53.634424+0000","last_undegraded":"2024-09-16T16:57:53.634424+0000","last_fullsized":"2024-09-16T16:57:53.634424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.402521+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:53.402521+0000","last_peered":"2024-09-16T16:57:53.402521+0000","last_clean":"2024-09-16T16:57:53.402521+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:53.402521+0000","last_undegraded":"2024-09-16T16:57:53.402521+0000","last_fullsized":"2024-09-16T16:57:53.402521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.569471+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:57:53.569471+0000","last_peered":"2024-09-16T16:57:53.569471+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:57:53.569471+0000","last_undegraded":"2024-09-16T16:57:53.569471+0000","last_fullsized":"2024-09-16T16:57:53.569471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391729+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:54.391729+0000","last_peered":"2024-09-16T16:57:54.391729+0000","last_clean":"2024-09-16T16:57:54.391729+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:54.391729+0000","last_undegraded":"2024-09-16T16:57:54.391729+0000","last_fullsized":"2024-09-16T16:57:54.391729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391534+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:57:54.391534+0000","last_peered":"2024-09-16T16:57:54.391534+0000","last_clean":"2024-09-16T16:57:54.391534+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:57:54.391534+0000","last_undegraded":"2024-09-16T16:57:54.391534+0000","last_fullsized":"2024-09-16T16:57:54.391534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393008+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:54.393008+0000","last_peered":"2024-09-16T16:57:54.393008+0000","last_clean":"2024-09-16T16:57:54.393008+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:54.393008+0000","last_undegraded":"2024-09-16T16:57:54.393008+0000","last_fullsized":"2024-09-16T16:57:54.393008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395686+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:57:54.395686+0000","last_peered":"2024-09-16T16:57:54.395686+0000","last_clean":"2024-09-16T16:57:54.395686+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:57:54.395686+0000","last_undegraded":"2024-09-16T16:57:54.395686+0000","last_fullsized":"2024-09-16T16:57:54.395686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395382+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:54.395382+0000","last_peered":"2024-09-16T16:57:54.395382+0000","last_clean":"2024-09-16T16:57:54.395382+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:54.395382+0000","last_undegraded":"2024-09-16T16:57:54.395382+0000","last_fullsized":"2024-09-16T16:57:54.395382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2724,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295004,"statfs":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2780,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294948,"statfs":{"total":53552873472,"available":53550026752,"internally_reserved":0,"allocated":2846720,"data_stored":2846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1828,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295900,"statfs":{"total":53552873472,"available":53551001600,"internally_reserved":0,"allocated":1871872,"data_stored":1871872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3056,"kb_used_data":3056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294672,"statfs":{"total":53552873472,"available":53549744128,"internally_reserved":0,"allocated":3129344,"data_stored":3129344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:02.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 823 807 0.788012 0.726562 0.11577 0.155677 2024-09-16T16:58:03.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 908 892 0.774232 0.664062 0.114249 0.158376 2024-09-16T16:58:03.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:03.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:03.659+0000 7f271db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:03.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:03.666+0000 7f271db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:04.500 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 991 975 0.761646 0.648438 0.0427086 0.161718 2024-09-16T16:58:05.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1107 1091 0.774783 0.90625 0.144508 0.160129 2024-09-16T16:58:05.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:05.942+0000 7f3ec6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:05.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:05.949+0000 7f3ec6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:06.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1222 1206 0.78508 0.898438 0.129169 0.158399 2024-09-16T16:58:07.162 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:07.162 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:07.162 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:07.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:07.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.302+0000 7fd00c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.322+0000 7fd00c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:07.391 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:07.392 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:07.394 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:07.395 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:07.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:07.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1333 1317 0.79139 0.867188 0.148538 0.156644 2024-09-16T16:58:07.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.511+0000 7f3bfff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.523+0000 7f3bfff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:07.542 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:07.544 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:07.544 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:07.545 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:07.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.666+0000 7ff931674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.680+0000 7ff931674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:07.769 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:07.770 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:07.772 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:07.772 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:07.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:07.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.888+0000 7f9993591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:07.902+0000 7f9993591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:07.933 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:07.933 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:08.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:08.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:08.304+0000 7f1684b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:08.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:08.313+0000 7f1684b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:08.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1451 1435 0.800704 0.921875 0.179004 0.155012 2024-09-16T16:58:09.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1570 1554 0.809298 0.929688 0.119067 0.153967 2024-09-16T16:58:10.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1689 1673 0.816817 0.929688 0.298788 0.152287 2024-09-16T16:58:10.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:10.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:10.717+0000 7f1e49f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:10.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:10.725+0000 7f1e49f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:11.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1794 1778 0.817017 0.820312 0.139823 0.15221 2024-09-16T16:58:12.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 1892 1876 0.814158 0.765625 0.18654 0.152188 2024-09-16T16:58:12.934 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:12.935 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:12.935 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:12.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:12.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:13.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.088+0000 7f9051151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.103+0000 7f9051151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.129+0000 7fc589a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.137+0000 7fc589a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:13.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:13.199 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:13.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:13.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.331+0000 7f07e3e8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.344+0000 7f07e3e8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:13.374 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:13.375 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:13.378 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:13.379 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:13.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:13.501 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 2005 1989 0.817767 0.882812 0.0895399 0.15245 2024-09-16T16:58:13.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.550+0000 7f2590151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.565+0000 7f2590151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:13.592 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:13.597 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:13.598 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:13.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:13.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.740+0000 7f879d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:13.753+0000 7f879d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:13.805 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:13.806 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:13.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:13.809 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:14.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:58:14.501876+0000 min lat: 0.0209942 max lat: 0.676612 avg lat: 0.15061 2024-09-16T16:58:14.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:58:14.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2133 2117 0.826874 1 0.0363663 0.15061 2024-09-16T16:58:15.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:15.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 16 2243 2227 0.828416 0.859375 0.0896983 0.150356 2024-09-16T16:58:15.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:15.523+0000 7f9b56791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:15.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:15.532+0000 7f9b56791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:16.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2354 2338 0.830175 0.867188 0.192793 0.149785 2024-09-16T16:58:17.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2438 2422 0.82261 0.65625 0.293803 0.15066 2024-09-16T16:58:17.889 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:18.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:18.008+0000 7fd7d605c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:18.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:18.017+0000 7fd7d605c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:18.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2527 2511 0.817303 0.695312 0.0638164 0.152194 2024-09-16T16:58:18.809 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:18.810 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:18.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:18.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:18.975+0000 7fdc87191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:18.989+0000 7fdc87191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:19.225 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:58:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:58:19.241 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":396,"stamp":"2024-09-16T16:58:18.495788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":10388,"kb_used_data":10388,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209180524,"statfs":{"total":214211493888,"available":214200856576,"internally_reserved":0,"allocated":10637312,"data_stored":10637312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002444"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.617830+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:57:53.617830+0000","last_peered":"2024-09-16T16:57:53.617830+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:57:53.617830+0000","last_undegraded":"2024-09-16T16:57:53.617830+0000","last_fullsized":"2024-09-16T16:57:53.617830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.396371+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:57:54.396371+0000","last_peered":"2024-09-16T16:57:54.396371+0000","last_clean":"2024-09-16T16:57:54.396371+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:57:54.396371+0000","last_undegraded":"2024-09-16T16:57:54.396371+0000","last_fullsized":"2024-09-16T16:57:54.396371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.390298+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:57:54.390298+0000","last_peered":"2024-09-16T16:57:54.390298+0000","last_clean":"2024-09-16T16:57:54.390298+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:57:54.390298+0000","last_undegraded":"2024-09-16T16:57:54.390298+0000","last_fullsized":"2024-09-16T16:57:54.390298+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.392654+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:57:54.392654+0000","last_peered":"2024-09-16T16:57:54.392654+0000","last_clean":"2024-09-16T16:57:54.392654+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:57:54.392654+0000","last_undegraded":"2024-09-16T16:57:54.392654+0000","last_fullsized":"2024-09-16T16:57:54.392654+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393853+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:57:54.393853+0000","last_peered":"2024-09-16T16:57:54.393853+0000","last_clean":"2024-09-16T16:57:54.393853+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:57:54.393853+0000","last_undegraded":"2024-09-16T16:57:54.393853+0000","last_fullsized":"2024-09-16T16:57:54.393853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397123+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:57:54.397123+0000","last_peered":"2024-09-16T16:57:54.397123+0000","last_clean":"2024-09-16T16:57:54.397123+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:57:54.397123+0000","last_undegraded":"2024-09-16T16:57:54.397123+0000","last_fullsized":"2024-09-16T16:57:54.397123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.628845+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:57:53.628845+0000","last_peered":"2024-09-16T16:57:53.628845+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:57:53.628845+0000","last_undegraded":"2024-09-16T16:57:53.628845+0000","last_fullsized":"2024-09-16T16:57:53.628845+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.619341+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:57:53.619341+0000","last_peered":"2024-09-16T16:57:53.619341+0000","last_clean":"2024-09-16T16:57:53.619341+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:57:53.619341+0000","last_undegraded":"2024-09-16T16:57:53.619341+0000","last_fullsized":"2024-09-16T16:57:53.619341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389003+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:57:54.389003+0000","last_peered":"2024-09-16T16:57:54.389003+0000","last_clean":"2024-09-16T16:57:54.389003+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:57:54.389003+0000","last_undegraded":"2024-09-16T16:57:54.389003+0000","last_fullsized":"2024-09-16T16:57:54.389003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":226,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.389643+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:54.389643+0000","last_peered":"2024-09-16T16:57:54.389643+0000","last_clean":"2024-09-16T16:57:54.389643+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:54.389643+0000","last_undegraded":"2024-09-16T16:57:54.389643+0000","last_fullsized":"2024-09-16T16:57:54.389643+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":152,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.397547+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:54.397547+0000","last_peered":"2024-09-16T16:57:54.397547+0000","last_clean":"2024-09-16T16:57:54.397547+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:54.397547+0000","last_undegraded":"2024-09-16T16:57:54.397547+0000","last_fullsized":"2024-09-16T16:57:54.397547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.577071+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:57:53.577071+0000","last_peered":"2024-09-16T16:57:53.577071+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:57:53.577071+0000","last_undegraded":"2024-09-16T16:57:53.577071+0000","last_fullsized":"2024-09-16T16:57:53.577071+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.429625+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:53.429625+0000","last_peered":"2024-09-16T16:57:53.429625+0000","last_clean":"2024-09-16T16:57:53.429625+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:53.429625+0000","last_undegraded":"2024-09-16T16:57:53.429625+0000","last_fullsized":"2024-09-16T16:57:53.429625+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394975+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:57:54.394975+0000","last_peered":"2024-09-16T16:57:54.394975+0000","last_clean":"2024-09-16T16:57:54.394975+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:57:54.394975+0000","last_undegraded":"2024-09-16T16:57:54.394975+0000","last_fullsized":"2024-09-16T16:57:54.394975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391487+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:54.391487+0000","last_peered":"2024-09-16T16:57:54.391487+0000","last_clean":"2024-09-16T16:57:54.391487+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:54.391487+0000","last_undegraded":"2024-09-16T16:57:54.391487+0000","last_fullsized":"2024-09-16T16:57:54.391487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.394527+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:57:54.394527+0000","last_peered":"2024-09-16T16:57:54.394527+0000","last_clean":"2024-09-16T16:57:54.394527+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:57:54.394527+0000","last_undegraded":"2024-09-16T16:57:54.394527+0000","last_fullsized":"2024-09-16T16:57:54.394527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":150,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.422632+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:53.422632+0000","last_peered":"2024-09-16T16:57:53.422632+0000","last_clean":"2024-09-16T16:57:53.422632+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:53.422632+0000","last_undegraded":"2024-09-16T16:57:53.422632+0000","last_fullsized":"2024-09-16T16:57:53.422632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.634424+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:57:53.634424+0000","last_peered":"2024-09-16T16:57:53.634424+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:57:53.634424+0000","last_undegraded":"2024-09-16T16:57:53.634424+0000","last_fullsized":"2024-09-16T16:57:53.634424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.402521+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:53.402521+0000","last_peered":"2024-09-16T16:57:53.402521+0000","last_clean":"2024-09-16T16:57:53.402521+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:53.402521+0000","last_undegraded":"2024-09-16T16:57:53.402521+0000","last_fullsized":"2024-09-16T16:57:53.402521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:53.569471+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:57:53.569471+0000","last_peered":"2024-09-16T16:57:53.569471+0000","last_clean":"2024-09-16T16:57:52.358430+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:57:53.569471+0000","last_undegraded":"2024-09-16T16:57:53.569471+0000","last_fullsized":"2024-09-16T16:57:53.569471+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391729+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:54.391729+0000","last_peered":"2024-09-16T16:57:54.391729+0000","last_clean":"2024-09-16T16:57:54.391729+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:54.391729+0000","last_undegraded":"2024-09-16T16:57:54.391729+0000","last_fullsized":"2024-09-16T16:57:54.391729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.391534+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:57:54.391534+0000","last_peered":"2024-09-16T16:57:54.391534+0000","last_clean":"2024-09-16T16:57:54.391534+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:57:54.391534+0000","last_undegraded":"2024-09-16T16:57:54.391534+0000","last_fullsized":"2024-09-16T16:57:54.391534+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.393008+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:54.393008+0000","last_peered":"2024-09-16T16:57:54.393008+0000","last_clean":"2024-09-16T16:57:54.393008+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:54.393008+0000","last_undegraded":"2024-09-16T16:57:54.393008+0000","last_fullsized":"2024-09-16T16:57:54.393008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395686+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:57:54.395686+0000","last_peered":"2024-09-16T16:57:54.395686+0000","last_clean":"2024-09-16T16:57:54.395686+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:57:54.395686+0000","last_undegraded":"2024-09-16T16:57:54.395686+0000","last_fullsized":"2024-09-16T16:57:54.395686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":151,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-16T16:57:54.395382+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:54.395382+0000","last_peered":"2024-09-16T16:57:54.395382+0000","last_clean":"2024-09-16T16:57:54.395382+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:54.395382+0000","last_undegraded":"2024-09-16T16:57:54.395382+0000","last_fullsized":"2024-09-16T16:57:54.395382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214200815616,"internally_reserved":0,"allocated":10678272,"data_stored":10678272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2724,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295004,"statfs":{"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2780,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294948,"statfs":{"total":53552873472,"available":53550026752,"internally_reserved":0,"allocated":2846720,"data_stored":2846720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1828,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295900,"statfs":{"total":53552873472,"available":53551001600,"internally_reserved":0,"allocated":1871872,"data_stored":1871872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3056,"kb_used_data":3056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294672,"statfs":{"total":53552873472,"available":53549744128,"internally_reserved":0,"allocated":3129344,"data_stored":3129344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53549719552,"internally_reserved":0,"allocated":3153920,"data_stored":3153920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53550993408,"internally_reserved":0,"allocated":1880064,"data_stored":1880064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53550018560,"internally_reserved":0,"allocated":2854912,"data_stored":2854912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53550084096,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:19.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2639 2623 0.819608 0.875 0.139816 0.151887 2024-09-16T16:58:20.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:20.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:20.465+0000 7f934d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:20.474+0000 7f934d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:20.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 2756 2740 0.823238 0.914062 0.209319 0.151457 2024-09-16T16:58:21.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 2850 2834 0.819943 0.734375 0.0587623 0.151702 2024-09-16T16:58:22.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 2942 2926 0.816327 0.71875 0.143979 0.151706 2024-09-16T16:58:22.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:22.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:22.853+0000 7f54f987f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:22.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:22.860+0000 7f54f987f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:23.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 3012 2996 0.807033 0.546875 0.400074 0.154098 2024-09-16T16:58:24.244 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:24.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:58:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:24.374+0000 7f20fef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:24.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:24.387+0000 7f20fef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:24.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 3105 3089 0.804349 0.726562 0.230795 0.154562 2024-09-16T16:58:24.978 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:25.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:25.111+0000 7f8276391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:25.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:25.120+0000 7f8276391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:25.418 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:58:25.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:58:25.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3198 3182 0.801838 0.726562 0.0926287 0.15519 2024-09-16T16:58:25.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:25.585+0000 7fc672d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:25.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:25.604+0000 7fc672d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.418 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:58:26.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:58:26.502 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3314 3298 0.805098 0.90625 0.232695 0.154733 2024-09-16T16:58:26.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:26.563+0000 7f5a69991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:26.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:26.576+0000 7f5a69991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:27.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:58:27.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:58:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:27.491+0000 7ff1e847f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:27.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3407 3391 0.802717 0.726562 0.305993 0.155004 2024-09-16T16:58:27.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:27.501+0000 7ff1e847f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:27.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:27.612+0000 7f8776391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:27.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:27.627+0000 7f8776391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:28.431 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:58:28.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:58:28.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:28.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3501 3485 0.800705 0.734375 0.171382 0.155736 2024-09-16T16:58:28.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:28.617+0000 7f9e2cb48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:28.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:28.630+0000 7f9e2cb48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.020 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:58:29.020 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:58:29.039 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-09-16T16:58:28.497706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25977395,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3180,"num_write_kb":25900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3154,"ondisk_log_size":3154,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":158008,"kb_used_data":158008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209032904,"statfs":{"total":214211493888,"available":214049693696,"internally_reserved":0,"allocated":161800192,"data_stored":161800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000753"},"pg_stats":[{"pgid":"9.7","version":"63'120","reported_seq":135,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:19.975325+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:19.975325+0000","last_peered":"2024-09-16T16:58:19.975325+0000","last_clean":"2024-09-16T16:58:19.975325+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:19.975325+0000","last_undegraded":"2024-09-16T16:58:19.975325+0000","last_fullsized":"2024-09-16T16:58:19.975325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"63'216","reported_seq":231,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.709552+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:21.709552+0000","last_peered":"2024-09-16T16:58:21.709552+0000","last_clean":"2024-09-16T16:58:21.709552+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:21.709552+0000","last_undegraded":"2024-09-16T16:58:21.709552+0000","last_fullsized":"2024-09-16T16:58:21.709552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"63'144","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.161030+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:24.161030+0000","last_peered":"2024-09-16T16:58:24.161030+0000","last_clean":"2024-09-16T16:58:24.161030+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:24.161030+0000","last_undegraded":"2024-09-16T16:58:24.161030+0000","last_fullsized":"2024-09-16T16:58:24.161030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.564066+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:23.564066+0000","last_peered":"2024-09-16T16:58:23.564066+0000","last_clean":"2024-09-16T16:58:23.564066+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:23.564066+0000","last_undegraded":"2024-09-16T16:58:23.564066+0000","last_fullsized":"2024-09-16T16:58:23.564066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"63'256","reported_seq":271,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:22.919606+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:22.919606+0000","last_peered":"2024-09-16T16:58:22.919606+0000","last_clean":"2024-09-16T16:58:22.919606+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:22.919606+0000","last_undegraded":"2024-09-16T16:58:22.919606+0000","last_fullsized":"2024-09-16T16:58:22.919606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.348791+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:23.348791+0000","last_peered":"2024-09-16T16:58:23.348791+0000","last_clean":"2024-09-16T16:58:23.348791+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:23.348791+0000","last_undegraded":"2024-09-16T16:58:23.348791+0000","last_fullsized":"2024-09-16T16:58:23.348791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.239728+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:24.239728+0000","last_peered":"2024-09-16T16:58:24.239728+0000","last_clean":"2024-09-16T16:58:24.239728+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:24.239728+0000","last_undegraded":"2024-09-16T16:58:24.239728+0000","last_fullsized":"2024-09-16T16:58:24.239728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"63'171","reported_seq":186,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.358231+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:24.358231+0000","last_peered":"2024-09-16T16:58:24.358231+0000","last_clean":"2024-09-16T16:58:24.358231+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:24.358231+0000","last_undegraded":"2024-09-16T16:58:24.358231+0000","last_fullsized":"2024-09-16T16:58:24.358231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400832,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":1368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.960854+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:23.960854+0000","last_peered":"2024-09-16T16:58:23.960854+0000","last_clean":"2024-09-16T16:58:23.960854+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:23.960854+0000","last_undegraded":"2024-09-16T16:58:23.960854+0000","last_fullsized":"2024-09-16T16:58:23.960854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.406318+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:55.406318+0000","last_peered":"2024-09-16T16:57:55.406318+0000","last_clean":"2024-09-16T16:57:55.406318+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:55.406318+0000","last_undegraded":"2024-09-16T16:57:55.406318+0000","last_fullsized":"2024-09-16T16:57:55.406318+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":155,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.419434+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:55.419434+0000","last_peered":"2024-09-16T16:57:55.419434+0000","last_clean":"2024-09-16T16:57:55.419434+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:55.419434+0000","last_undegraded":"2024-09-16T16:57:55.419434+0000","last_fullsized":"2024-09-16T16:57:55.419434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.632466+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:21.632466+0000","last_peered":"2024-09-16T16:58:21.632466+0000","last_clean":"2024-09-16T16:58:21.632466+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:21.632466+0000","last_undegraded":"2024-09-16T16:58:21.632466+0000","last_fullsized":"2024-09-16T16:58:21.632466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.640509+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:55.640509+0000","last_peered":"2024-09-16T16:57:55.640509+0000","last_clean":"2024-09-16T16:57:55.640509+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:55.640509+0000","last_undegraded":"2024-09-16T16:57:55.640509+0000","last_fullsized":"2024-09-16T16:57:55.640509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.015600+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:24.015600+0000","last_peered":"2024-09-16T16:58:24.015600+0000","last_clean":"2024-09-16T16:58:24.015600+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:24.015600+0000","last_undegraded":"2024-09-16T16:58:24.015600+0000","last_fullsized":"2024-09-16T16:58:24.015600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.412357+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:55.412357+0000","last_peered":"2024-09-16T16:57:55.412357+0000","last_clean":"2024-09-16T16:57:55.412357+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:55.412357+0000","last_undegraded":"2024-09-16T16:57:55.412357+0000","last_fullsized":"2024-09-16T16:57:55.412357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"63'264","reported_seq":279,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.307872+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:24.307872+0000","last_peered":"2024-09-16T16:58:24.307872+0000","last_clean":"2024-09-16T16:58:24.307872+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:24.307872+0000","last_undegraded":"2024-09-16T16:58:24.307872+0000","last_fullsized":"2024-09-16T16:58:24.307872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":156,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.625817+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:55.625817+0000","last_peered":"2024-09-16T16:57:55.625817+0000","last_clean":"2024-09-16T16:57:55.625817+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:55.625817+0000","last_undegraded":"2024-09-16T16:57:55.625817+0000","last_fullsized":"2024-09-16T16:57:55.625817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"63'248","reported_seq":263,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.664476+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:23.664476+0000","last_peered":"2024-09-16T16:58:23.664476+0000","last_clean":"2024-09-16T16:58:23.664476+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:23.664476+0000","last_undegraded":"2024-09-16T16:58:23.664476+0000","last_fullsized":"2024-09-16T16:58:23.664476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.440058+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:55.440058+0000","last_peered":"2024-09-16T16:57:55.440058+0000","last_clean":"2024-09-16T16:57:55.440058+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:55.440058+0000","last_undegraded":"2024-09-16T16:57:55.440058+0000","last_fullsized":"2024-09-16T16:57:55.440058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.450179+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:21.450179+0000","last_peered":"2024-09-16T16:58:21.450179+0000","last_clean":"2024-09-16T16:58:21.450179+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:21.450179+0000","last_undegraded":"2024-09-16T16:58:21.450179+0000","last_fullsized":"2024-09-16T16:58:21.450179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.408957+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:55.408957+0000","last_peered":"2024-09-16T16:57:55.408957+0000","last_clean":"2024-09-16T16:57:55.408957+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:55.408957+0000","last_undegraded":"2024-09-16T16:57:55.408957+0000","last_fullsized":"2024-09-16T16:57:55.408957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.242593+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:23.242593+0000","last_peered":"2024-09-16T16:58:23.242593+0000","last_clean":"2024-09-16T16:58:23.242593+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:23.242593+0000","last_undegraded":"2024-09-16T16:58:23.242593+0000","last_fullsized":"2024-09-16T16:58:23.242593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.437529+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:55.437529+0000","last_peered":"2024-09-16T16:57:55.437529+0000","last_clean":"2024-09-16T16:57:55.437529+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:55.437529+0000","last_undegraded":"2024-09-16T16:57:55.437529+0000","last_fullsized":"2024-09-16T16:57:55.437529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.416599+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:23.416599+0000","last_peered":"2024-09-16T16:58:23.416599+0000","last_clean":"2024-09-16T16:58:23.416599+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:23.416599+0000","last_undegraded":"2024-09-16T16:58:23.416599+0000","last_fullsized":"2024-09-16T16:58:23.416599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.417516+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:55.417516+0000","last_peered":"2024-09-16T16:57:55.417516+0000","last_clean":"2024-09-16T16:57:55.417516+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:55.417516+0000","last_undegraded":"2024-09-16T16:57:55.417516+0000","last_fullsized":"2024-09-16T16:57:55.417516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":25387008,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3099,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046646272,"internally_reserved":0,"allocated":164847616,"data_stored":164847616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3099,"ondisk_log_size":3099,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046654464,"internally_reserved":0,"allocated":164839424,"data_stored":164839424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":43816,"kb_used_data":43816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52253912,"statfs":{"total":53552873472,"available":53508005888,"internally_reserved":0,"allocated":44867584,"data_stored":44867584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34804,"kb_used_data":34804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52262924,"statfs":{"total":53552873472,"available":53517234176,"internally_reserved":0,"allocated":35639296,"data_stored":35639296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":30376,"kb_used_data":30376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52267352,"statfs":{"total":53552873472,"available":53521768448,"internally_reserved":0,"allocated":31105024,"data_stored":31105024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":49012,"kb_used_data":49012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52248716,"statfs":{"total":53552873472,"available":53502685184,"internally_reserved":0,"allocated":50188288,"data_stored":50188288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53501755392,"internally_reserved":0,"allocated":51118080,"data_stored":51118080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53501747200,"internally_reserved":0,"allocated":51126272,"data_stored":51126272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:29.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:29.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.164+0000 7f6d2af51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.176+0000 7f6d2af51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.408 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:58:29.408 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:58:29.425 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-09-16T16:58:28.497706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25977395,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3180,"num_write_kb":25900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3154,"ondisk_log_size":3154,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":158008,"kb_used_data":158008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209032904,"statfs":{"total":214211493888,"available":214049693696,"internally_reserved":0,"allocated":161800192,"data_stored":161800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000753"},"pg_stats":[{"pgid":"9.7","version":"63'120","reported_seq":135,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:19.975325+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:19.975325+0000","last_peered":"2024-09-16T16:58:19.975325+0000","last_clean":"2024-09-16T16:58:19.975325+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:19.975325+0000","last_undegraded":"2024-09-16T16:58:19.975325+0000","last_fullsized":"2024-09-16T16:58:19.975325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"63'216","reported_seq":231,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.709552+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:21.709552+0000","last_peered":"2024-09-16T16:58:21.709552+0000","last_clean":"2024-09-16T16:58:21.709552+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:21.709552+0000","last_undegraded":"2024-09-16T16:58:21.709552+0000","last_fullsized":"2024-09-16T16:58:21.709552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"63'144","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.161030+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:24.161030+0000","last_peered":"2024-09-16T16:58:24.161030+0000","last_clean":"2024-09-16T16:58:24.161030+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:24.161030+0000","last_undegraded":"2024-09-16T16:58:24.161030+0000","last_fullsized":"2024-09-16T16:58:24.161030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.564066+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:23.564066+0000","last_peered":"2024-09-16T16:58:23.564066+0000","last_clean":"2024-09-16T16:58:23.564066+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:23.564066+0000","last_undegraded":"2024-09-16T16:58:23.564066+0000","last_fullsized":"2024-09-16T16:58:23.564066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"63'256","reported_seq":271,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:22.919606+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:22.919606+0000","last_peered":"2024-09-16T16:58:22.919606+0000","last_clean":"2024-09-16T16:58:22.919606+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:22.919606+0000","last_undegraded":"2024-09-16T16:58:22.919606+0000","last_fullsized":"2024-09-16T16:58:22.919606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.348791+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:23.348791+0000","last_peered":"2024-09-16T16:58:23.348791+0000","last_clean":"2024-09-16T16:58:23.348791+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:23.348791+0000","last_undegraded":"2024-09-16T16:58:23.348791+0000","last_fullsized":"2024-09-16T16:58:23.348791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.239728+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:24.239728+0000","last_peered":"2024-09-16T16:58:24.239728+0000","last_clean":"2024-09-16T16:58:24.239728+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:24.239728+0000","last_undegraded":"2024-09-16T16:58:24.239728+0000","last_fullsized":"2024-09-16T16:58:24.239728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"63'171","reported_seq":186,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.358231+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:24.358231+0000","last_peered":"2024-09-16T16:58:24.358231+0000","last_clean":"2024-09-16T16:58:24.358231+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:24.358231+0000","last_undegraded":"2024-09-16T16:58:24.358231+0000","last_fullsized":"2024-09-16T16:58:24.358231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400832,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":1368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.960854+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:23.960854+0000","last_peered":"2024-09-16T16:58:23.960854+0000","last_clean":"2024-09-16T16:58:23.960854+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:23.960854+0000","last_undegraded":"2024-09-16T16:58:23.960854+0000","last_fullsized":"2024-09-16T16:58:23.960854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.406318+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:55.406318+0000","last_peered":"2024-09-16T16:57:55.406318+0000","last_clean":"2024-09-16T16:57:55.406318+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:55.406318+0000","last_undegraded":"2024-09-16T16:57:55.406318+0000","last_fullsized":"2024-09-16T16:57:55.406318+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":155,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.419434+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:55.419434+0000","last_peered":"2024-09-16T16:57:55.419434+0000","last_clean":"2024-09-16T16:57:55.419434+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:55.419434+0000","last_undegraded":"2024-09-16T16:57:55.419434+0000","last_fullsized":"2024-09-16T16:57:55.419434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.632466+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:21.632466+0000","last_peered":"2024-09-16T16:58:21.632466+0000","last_clean":"2024-09-16T16:58:21.632466+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:21.632466+0000","last_undegraded":"2024-09-16T16:58:21.632466+0000","last_fullsized":"2024-09-16T16:58:21.632466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.640509+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:55.640509+0000","last_peered":"2024-09-16T16:57:55.640509+0000","last_clean":"2024-09-16T16:57:55.640509+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:55.640509+0000","last_undegraded":"2024-09-16T16:57:55.640509+0000","last_fullsized":"2024-09-16T16:57:55.640509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.015600+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:24.015600+0000","last_peered":"2024-09-16T16:58:24.015600+0000","last_clean":"2024-09-16T16:58:24.015600+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:24.015600+0000","last_undegraded":"2024-09-16T16:58:24.015600+0000","last_fullsized":"2024-09-16T16:58:24.015600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.412357+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:55.412357+0000","last_peered":"2024-09-16T16:57:55.412357+0000","last_clean":"2024-09-16T16:57:55.412357+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:55.412357+0000","last_undegraded":"2024-09-16T16:57:55.412357+0000","last_fullsized":"2024-09-16T16:57:55.412357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"63'264","reported_seq":279,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.307872+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:24.307872+0000","last_peered":"2024-09-16T16:58:24.307872+0000","last_clean":"2024-09-16T16:58:24.307872+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:24.307872+0000","last_undegraded":"2024-09-16T16:58:24.307872+0000","last_fullsized":"2024-09-16T16:58:24.307872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":156,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.625817+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:55.625817+0000","last_peered":"2024-09-16T16:57:55.625817+0000","last_clean":"2024-09-16T16:57:55.625817+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:55.625817+0000","last_undegraded":"2024-09-16T16:57:55.625817+0000","last_fullsized":"2024-09-16T16:57:55.625817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"63'248","reported_seq":263,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.664476+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:23.664476+0000","last_peered":"2024-09-16T16:58:23.664476+0000","last_clean":"2024-09-16T16:58:23.664476+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:23.664476+0000","last_undegraded":"2024-09-16T16:58:23.664476+0000","last_fullsized":"2024-09-16T16:58:23.664476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.440058+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:55.440058+0000","last_peered":"2024-09-16T16:57:55.440058+0000","last_clean":"2024-09-16T16:57:55.440058+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:55.440058+0000","last_undegraded":"2024-09-16T16:57:55.440058+0000","last_fullsized":"2024-09-16T16:57:55.440058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.450179+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:21.450179+0000","last_peered":"2024-09-16T16:58:21.450179+0000","last_clean":"2024-09-16T16:58:21.450179+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:21.450179+0000","last_undegraded":"2024-09-16T16:58:21.450179+0000","last_fullsized":"2024-09-16T16:58:21.450179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.408957+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:55.408957+0000","last_peered":"2024-09-16T16:57:55.408957+0000","last_clean":"2024-09-16T16:57:55.408957+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:55.408957+0000","last_undegraded":"2024-09-16T16:57:55.408957+0000","last_fullsized":"2024-09-16T16:57:55.408957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.242593+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:23.242593+0000","last_peered":"2024-09-16T16:58:23.242593+0000","last_clean":"2024-09-16T16:58:23.242593+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:23.242593+0000","last_undegraded":"2024-09-16T16:58:23.242593+0000","last_fullsized":"2024-09-16T16:58:23.242593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.437529+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:55.437529+0000","last_peered":"2024-09-16T16:57:55.437529+0000","last_clean":"2024-09-16T16:57:55.437529+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:55.437529+0000","last_undegraded":"2024-09-16T16:57:55.437529+0000","last_fullsized":"2024-09-16T16:57:55.437529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.416599+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:23.416599+0000","last_peered":"2024-09-16T16:58:23.416599+0000","last_clean":"2024-09-16T16:58:23.416599+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:23.416599+0000","last_undegraded":"2024-09-16T16:58:23.416599+0000","last_fullsized":"2024-09-16T16:58:23.416599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.417516+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:55.417516+0000","last_peered":"2024-09-16T16:57:55.417516+0000","last_clean":"2024-09-16T16:57:55.417516+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:55.417516+0000","last_undegraded":"2024-09-16T16:57:55.417516+0000","last_fullsized":"2024-09-16T16:57:55.417516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":25387008,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3099,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046646272,"internally_reserved":0,"allocated":164847616,"data_stored":164847616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3099,"ondisk_log_size":3099,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046654464,"internally_reserved":0,"allocated":164839424,"data_stored":164839424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":43816,"kb_used_data":43816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52253912,"statfs":{"total":53552873472,"available":53508005888,"internally_reserved":0,"allocated":44867584,"data_stored":44867584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34804,"kb_used_data":34804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52262924,"statfs":{"total":53552873472,"available":53517234176,"internally_reserved":0,"allocated":35639296,"data_stored":35639296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":30376,"kb_used_data":30376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52267352,"statfs":{"total":53552873472,"available":53521768448,"internally_reserved":0,"allocated":31105024,"data_stored":31105024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":49012,"kb_used_data":49012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52248716,"statfs":{"total":53552873472,"available":53502685184,"internally_reserved":0,"allocated":50188288,"data_stored":50188288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53501755392,"internally_reserved":0,"allocated":51118080,"data_stored":51118080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53501747200,"internally_reserved":0,"allocated":51126272,"data_stored":51126272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:29.426 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:58:29.426 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:29.426 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:29.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:29.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 3567 3551 0.792558 0.515625 0.11447 0.157286 2024-09-16T16:58:29.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.552+0000 7f125044f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.565+0000 7f125044f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:29.800 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:29.803 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:29.803 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:29.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.831+0000 7f0118efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.838+0000 7f0118efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.931+0000 7f863aeac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:29.942+0000 7f863aeac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:29.965 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:29.970 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:29.970 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:29.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:30.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:30.157+0000 7f6397488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:30.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:30.174+0000 7f6397488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:30.271 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:30.272 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:30.275 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:30.275 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:30.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:30.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:30.456+0000 7f94fb6ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:30.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:30.471+0000 7f94fb6ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:30.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 3667 3651 0.792242 0.78125 0.0718126 0.157364 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:30.565 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:30.566 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:30.569 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:30.569 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:31.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 3768 3752 0.792154 0.789062 0.246218 0.157508 2024-09-16T16:58:32.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:32.301+0000 7f6a3a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:32.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:32.308+0000 7f6a3a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:32.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 3878 3862 0.793921 0.859375 0.0455825 0.156879 2024-09-16T16:58:33.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 3977 3961 0.793394 0.773438 0.102442 0.156867 2024-09-16T16:58:34.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:34.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:58:34.503785+0000 min lat: 0.0209942 max lat: 0.851425 avg lat: 0.156426 2024-09-16T16:58:34.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:58:34.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4103 4087 0.798166 0.984375 0.211116 0.156426 2024-09-16T16:58:34.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:34.603+0000 7f0a94791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:34.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:34.610+0000 7f0a94791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:35.503 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4198 4182 0.796798 0.742188 0.157083 0.156319 2024-09-16T16:58:35.570 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:35.570 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:35.570 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:35.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:35.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:35.719+0000 7fee67f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:35.733+0000 7fee67f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:35.805 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:35.805 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:35.805 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:35.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:35.809 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:35.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:35.928+0000 7f0c77111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:35.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:35.941+0000 7f0c77111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:35.969 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:35.970 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:35.973 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:35.973 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:35.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:36.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:36.093+0000 7fd5e3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:36.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:36.105+0000 7fd5e3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:36.125 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:36.128 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:36.129 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:36.129 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:36.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:36.254+0000 7f842ca7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:36.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:36.268+0000 7f842ca7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:36.359 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:36.361 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:36.362 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:36.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4312 4296 0.79903 0.890625 0.0773844 0.156168 2024-09-16T16:58:36.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:37.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:37.111+0000 7f5a45951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:37.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:37.119+0000 7f5a45951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:37.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4425 4409 0.800977 0.882812 0.0665991 0.155771 2024-09-16T16:58:38.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 16 4533 4517 0.801947 0.84375 0.169062 0.155586 2024-09-16T16:58:39.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:39.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 4637 4621 0.802179 0.8125 0.115462 0.15563 2024-09-16T16:58:39.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:39.544+0000 7f00a7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:39.554+0000 7f00a612f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:40.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 4719 4703 0.798665 0.640625 0.313026 0.156021 2024-09-16T16:58:41.362 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:41.363 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:41.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:41.479+0000 7f818f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:41.489+0000 7f818f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:41.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 16 4793 4777 0.793971 0.578125 0.145858 0.156817 2024-09-16T16:58:41.722 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:58:41.722 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:58:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":413,"stamp":"2024-09-16T16:58:40.499887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25977395,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3180,"num_write_kb":25900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3154,"ondisk_log_size":3154,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":158008,"kb_used_data":158008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209032904,"statfs":{"total":214211493888,"available":214049693696,"internally_reserved":0,"allocated":161800192,"data_stored":161800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.366623"},"pg_stats":[{"pgid":"9.7","version":"63'120","reported_seq":135,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:19.975325+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:19.975325+0000","last_peered":"2024-09-16T16:58:19.975325+0000","last_clean":"2024-09-16T16:58:19.975325+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:19.975325+0000","last_undegraded":"2024-09-16T16:58:19.975325+0000","last_fullsized":"2024-09-16T16:58:19.975325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"63'216","reported_seq":231,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.709552+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:21.709552+0000","last_peered":"2024-09-16T16:58:21.709552+0000","last_clean":"2024-09-16T16:58:21.709552+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:21.709552+0000","last_undegraded":"2024-09-16T16:58:21.709552+0000","last_fullsized":"2024-09-16T16:58:21.709552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"63'144","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.161030+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:24.161030+0000","last_peered":"2024-09-16T16:58:24.161030+0000","last_clean":"2024-09-16T16:58:24.161030+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:24.161030+0000","last_undegraded":"2024-09-16T16:58:24.161030+0000","last_fullsized":"2024-09-16T16:58:24.161030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.564066+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:23.564066+0000","last_peered":"2024-09-16T16:58:23.564066+0000","last_clean":"2024-09-16T16:58:23.564066+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:23.564066+0000","last_undegraded":"2024-09-16T16:58:23.564066+0000","last_fullsized":"2024-09-16T16:58:23.564066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"63'256","reported_seq":271,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:22.919606+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:22.919606+0000","last_peered":"2024-09-16T16:58:22.919606+0000","last_clean":"2024-09-16T16:58:22.919606+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:22.919606+0000","last_undegraded":"2024-09-16T16:58:22.919606+0000","last_fullsized":"2024-09-16T16:58:22.919606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.348791+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:23.348791+0000","last_peered":"2024-09-16T16:58:23.348791+0000","last_clean":"2024-09-16T16:58:23.348791+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:23.348791+0000","last_undegraded":"2024-09-16T16:58:23.348791+0000","last_fullsized":"2024-09-16T16:58:23.348791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.239728+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:24.239728+0000","last_peered":"2024-09-16T16:58:24.239728+0000","last_clean":"2024-09-16T16:58:24.239728+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:24.239728+0000","last_undegraded":"2024-09-16T16:58:24.239728+0000","last_fullsized":"2024-09-16T16:58:24.239728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"63'171","reported_seq":186,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.358231+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:24.358231+0000","last_peered":"2024-09-16T16:58:24.358231+0000","last_clean":"2024-09-16T16:58:24.358231+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:24.358231+0000","last_undegraded":"2024-09-16T16:58:24.358231+0000","last_fullsized":"2024-09-16T16:58:24.358231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400832,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":1368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.960854+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:23.960854+0000","last_peered":"2024-09-16T16:58:23.960854+0000","last_clean":"2024-09-16T16:58:23.960854+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:23.960854+0000","last_undegraded":"2024-09-16T16:58:23.960854+0000","last_fullsized":"2024-09-16T16:58:23.960854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.406318+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:55.406318+0000","last_peered":"2024-09-16T16:57:55.406318+0000","last_clean":"2024-09-16T16:57:55.406318+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:55.406318+0000","last_undegraded":"2024-09-16T16:57:55.406318+0000","last_fullsized":"2024-09-16T16:57:55.406318+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":155,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.419434+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:55.419434+0000","last_peered":"2024-09-16T16:57:55.419434+0000","last_clean":"2024-09-16T16:57:55.419434+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:55.419434+0000","last_undegraded":"2024-09-16T16:57:55.419434+0000","last_fullsized":"2024-09-16T16:57:55.419434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.632466+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:21.632466+0000","last_peered":"2024-09-16T16:58:21.632466+0000","last_clean":"2024-09-16T16:58:21.632466+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:21.632466+0000","last_undegraded":"2024-09-16T16:58:21.632466+0000","last_fullsized":"2024-09-16T16:58:21.632466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.640509+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:55.640509+0000","last_peered":"2024-09-16T16:57:55.640509+0000","last_clean":"2024-09-16T16:57:55.640509+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:55.640509+0000","last_undegraded":"2024-09-16T16:57:55.640509+0000","last_fullsized":"2024-09-16T16:57:55.640509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.015600+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:24.015600+0000","last_peered":"2024-09-16T16:58:24.015600+0000","last_clean":"2024-09-16T16:58:24.015600+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:24.015600+0000","last_undegraded":"2024-09-16T16:58:24.015600+0000","last_fullsized":"2024-09-16T16:58:24.015600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.412357+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:55.412357+0000","last_peered":"2024-09-16T16:57:55.412357+0000","last_clean":"2024-09-16T16:57:55.412357+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:55.412357+0000","last_undegraded":"2024-09-16T16:57:55.412357+0000","last_fullsized":"2024-09-16T16:57:55.412357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"63'264","reported_seq":279,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.307872+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:24.307872+0000","last_peered":"2024-09-16T16:58:24.307872+0000","last_clean":"2024-09-16T16:58:24.307872+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:24.307872+0000","last_undegraded":"2024-09-16T16:58:24.307872+0000","last_fullsized":"2024-09-16T16:58:24.307872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":156,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.625817+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:55.625817+0000","last_peered":"2024-09-16T16:57:55.625817+0000","last_clean":"2024-09-16T16:57:55.625817+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:55.625817+0000","last_undegraded":"2024-09-16T16:57:55.625817+0000","last_fullsized":"2024-09-16T16:57:55.625817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"63'248","reported_seq":263,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.664476+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:23.664476+0000","last_peered":"2024-09-16T16:58:23.664476+0000","last_clean":"2024-09-16T16:58:23.664476+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:23.664476+0000","last_undegraded":"2024-09-16T16:58:23.664476+0000","last_fullsized":"2024-09-16T16:58:23.664476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.440058+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:55.440058+0000","last_peered":"2024-09-16T16:57:55.440058+0000","last_clean":"2024-09-16T16:57:55.440058+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:55.440058+0000","last_undegraded":"2024-09-16T16:57:55.440058+0000","last_fullsized":"2024-09-16T16:57:55.440058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.450179+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:21.450179+0000","last_peered":"2024-09-16T16:58:21.450179+0000","last_clean":"2024-09-16T16:58:21.450179+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:21.450179+0000","last_undegraded":"2024-09-16T16:58:21.450179+0000","last_fullsized":"2024-09-16T16:58:21.450179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.408957+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:55.408957+0000","last_peered":"2024-09-16T16:57:55.408957+0000","last_clean":"2024-09-16T16:57:55.408957+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:55.408957+0000","last_undegraded":"2024-09-16T16:57:55.408957+0000","last_fullsized":"2024-09-16T16:57:55.408957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.242593+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:23.242593+0000","last_peered":"2024-09-16T16:58:23.242593+0000","last_clean":"2024-09-16T16:58:23.242593+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:23.242593+0000","last_undegraded":"2024-09-16T16:58:23.242593+0000","last_fullsized":"2024-09-16T16:58:23.242593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.437529+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:55.437529+0000","last_peered":"2024-09-16T16:57:55.437529+0000","last_clean":"2024-09-16T16:57:55.437529+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:55.437529+0000","last_undegraded":"2024-09-16T16:57:55.437529+0000","last_fullsized":"2024-09-16T16:57:55.437529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.416599+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:23.416599+0000","last_peered":"2024-09-16T16:58:23.416599+0000","last_clean":"2024-09-16T16:58:23.416599+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:23.416599+0000","last_undegraded":"2024-09-16T16:58:23.416599+0000","last_fullsized":"2024-09-16T16:58:23.416599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.417516+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:55.417516+0000","last_peered":"2024-09-16T16:57:55.417516+0000","last_clean":"2024-09-16T16:57:55.417516+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:55.417516+0000","last_undegraded":"2024-09-16T16:57:55.417516+0000","last_fullsized":"2024-09-16T16:57:55.417516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":25387008,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3099,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046646272,"internally_reserved":0,"allocated":164847616,"data_stored":164847616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3099,"ondisk_log_size":3099,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046654464,"internally_reserved":0,"allocated":164839424,"data_stored":164839424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":43816,"kb_used_data":43816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52253912,"statfs":{"total":53552873472,"available":53508005888,"internally_reserved":0,"allocated":44867584,"data_stored":44867584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34804,"kb_used_data":34804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52262924,"statfs":{"total":53552873472,"available":53517234176,"internally_reserved":0,"allocated":35639296,"data_stored":35639296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":30376,"kb_used_data":30376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52267352,"statfs":{"total":53552873472,"available":53521768448,"internally_reserved":0,"allocated":31105024,"data_stored":31105024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":49012,"kb_used_data":49012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52248716,"statfs":{"total":53552873472,"available":53502685184,"internally_reserved":0,"allocated":50188288,"data_stored":50188288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53501755392,"internally_reserved":0,"allocated":51118080,"data_stored":51118080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53501747200,"internally_reserved":0,"allocated":51126272,"data_stored":51126272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:41.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:41.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:41.890+0000 7ff30dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:41.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:41.898+0000 7ff30dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:42.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 4875 4859 0.790775 0.640625 0.13374 0.15792 2024-09-16T16:58:43.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 4964 4948 0.788825 0.695312 0.24064 0.157747 2024-09-16T16:58:44.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:44.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:44.286+0000 7fb895191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:44.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:44.293+0000 7fb895191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:44.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 5065 5049 0.788829 0.789062 0.125295 0.158166 2024-09-16T16:58:45.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5152 5136 0.786688 0.679688 0.0523665 0.15842 2024-09-16T16:58:46.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:46.504 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 16 5271 5255 0.789436 0.929688 0.132135 0.158124 2024-09-16T16:58:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:46.624+0000 7f9f818d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:46.632+0000 7f9f818d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:46.739 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:46.739 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:46.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:46.873+0000 7ff5c56c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:46.883+0000 7ff5c56c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:47.166 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:58:47.166 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:58:47.182 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2024-09-16T16:58:47.138054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25977395,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3180,"num_write_kb":25900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3154,"ondisk_log_size":3154,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":158008,"kb_used_data":158008,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209032904,"statfs":{"total":214211493888,"available":214049693696,"internally_reserved":0,"allocated":161800192,"data_stored":161800192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.638529"},"pg_stats":[{"pgid":"9.7","version":"63'120","reported_seq":135,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:19.975325+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:19.975325+0000","last_peered":"2024-09-16T16:58:19.975325+0000","last_clean":"2024-09-16T16:58:19.975325+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:19.975325+0000","last_undegraded":"2024-09-16T16:58:19.975325+0000","last_fullsized":"2024-09-16T16:58:19.975325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"63'216","reported_seq":231,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.709552+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:21.709552+0000","last_peered":"2024-09-16T16:58:21.709552+0000","last_clean":"2024-09-16T16:58:21.709552+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:21.709552+0000","last_undegraded":"2024-09-16T16:58:21.709552+0000","last_fullsized":"2024-09-16T16:58:21.709552+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"63'144","reported_seq":159,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.161030+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:24.161030+0000","last_peered":"2024-09-16T16:58:24.161030+0000","last_clean":"2024-09-16T16:58:24.161030+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:24.161030+0000","last_undegraded":"2024-09-16T16:58:24.161030+0000","last_fullsized":"2024-09-16T16:58:24.161030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.564066+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:23.564066+0000","last_peered":"2024-09-16T16:58:23.564066+0000","last_clean":"2024-09-16T16:58:23.564066+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:23.564066+0000","last_undegraded":"2024-09-16T16:58:23.564066+0000","last_fullsized":"2024-09-16T16:58:23.564066+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"63'256","reported_seq":271,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:22.919606+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:22.919606+0000","last_peered":"2024-09-16T16:58:22.919606+0000","last_clean":"2024-09-16T16:58:22.919606+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:22.919606+0000","last_undegraded":"2024-09-16T16:58:22.919606+0000","last_fullsized":"2024-09-16T16:58:22.919606+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.348791+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:23.348791+0000","last_peered":"2024-09-16T16:58:23.348791+0000","last_clean":"2024-09-16T16:58:23.348791+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:23.348791+0000","last_undegraded":"2024-09-16T16:58:23.348791+0000","last_fullsized":"2024-09-16T16:58:23.348791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.239728+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:24.239728+0000","last_peered":"2024-09-16T16:58:24.239728+0000","last_clean":"2024-09-16T16:58:24.239728+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:24.239728+0000","last_undegraded":"2024-09-16T16:58:24.239728+0000","last_fullsized":"2024-09-16T16:58:24.239728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"63'171","reported_seq":186,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.358231+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:24.358231+0000","last_peered":"2024-09-16T16:58:24.358231+0000","last_clean":"2024-09-16T16:58:24.358231+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:24.358231+0000","last_undegraded":"2024-09-16T16:58:24.358231+0000","last_fullsized":"2024-09-16T16:58:24.358231+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400832,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":1368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"63'192","reported_seq":207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.960854+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:23.960854+0000","last_peered":"2024-09-16T16:58:23.960854+0000","last_clean":"2024-09-16T16:58:23.960854+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:23.960854+0000","last_undegraded":"2024-09-16T16:58:23.960854+0000","last_fullsized":"2024-09-16T16:58:23.960854+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":229,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.406318+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:57:55.406318+0000","last_peered":"2024-09-16T16:57:55.406318+0000","last_clean":"2024-09-16T16:57:55.406318+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:57:55.406318+0000","last_undegraded":"2024-09-16T16:57:55.406318+0000","last_fullsized":"2024-09-16T16:57:55.406318+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":155,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.419434+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:57:55.419434+0000","last_peered":"2024-09-16T16:57:55.419434+0000","last_clean":"2024-09-16T16:57:55.419434+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:57:55.419434+0000","last_undegraded":"2024-09-16T16:57:55.419434+0000","last_fullsized":"2024-09-16T16:57:55.419434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.632466+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:21.632466+0000","last_peered":"2024-09-16T16:58:21.632466+0000","last_clean":"2024-09-16T16:58:21.632466+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:21.632466+0000","last_undegraded":"2024-09-16T16:58:21.632466+0000","last_fullsized":"2024-09-16T16:58:21.632466+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.640509+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:57:55.640509+0000","last_peered":"2024-09-16T16:57:55.640509+0000","last_clean":"2024-09-16T16:57:55.640509+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:57:55.640509+0000","last_undegraded":"2024-09-16T16:57:55.640509+0000","last_fullsized":"2024-09-16T16:57:55.640509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.015600+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:24.015600+0000","last_peered":"2024-09-16T16:58:24.015600+0000","last_clean":"2024-09-16T16:58:24.015600+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:24.015600+0000","last_undegraded":"2024-09-16T16:58:24.015600+0000","last_fullsized":"2024-09-16T16:58:24.015600+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.412357+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:57:55.412357+0000","last_peered":"2024-09-16T16:57:55.412357+0000","last_clean":"2024-09-16T16:57:55.412357+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:57:55.412357+0000","last_undegraded":"2024-09-16T16:57:55.412357+0000","last_fullsized":"2024-09-16T16:57:55.412357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"63'264","reported_seq":279,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:24.307872+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:24.307872+0000","last_peered":"2024-09-16T16:58:24.307872+0000","last_clean":"2024-09-16T16:58:24.307872+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:24.307872+0000","last_undegraded":"2024-09-16T16:58:24.307872+0000","last_fullsized":"2024-09-16T16:58:24.307872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":156,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.625817+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:57:55.625817+0000","last_peered":"2024-09-16T16:57:55.625817+0000","last_clean":"2024-09-16T16:57:55.625817+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:57:55.625817+0000","last_undegraded":"2024-09-16T16:57:55.625817+0000","last_fullsized":"2024-09-16T16:57:55.625817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"63'248","reported_seq":263,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.664476+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:23.664476+0000","last_peered":"2024-09-16T16:58:23.664476+0000","last_clean":"2024-09-16T16:58:23.664476+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:23.664476+0000","last_undegraded":"2024-09-16T16:58:23.664476+0000","last_fullsized":"2024-09-16T16:58:23.664476+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.440058+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:57:55.440058+0000","last_peered":"2024-09-16T16:57:55.440058+0000","last_clean":"2024-09-16T16:57:55.440058+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:57:55.440058+0000","last_undegraded":"2024-09-16T16:57:55.440058+0000","last_fullsized":"2024-09-16T16:57:55.440058+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"63'160","reported_seq":175,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:21.450179+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:21.450179+0000","last_peered":"2024-09-16T16:58:21.450179+0000","last_clean":"2024-09-16T16:58:21.450179+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:21.450179+0000","last_undegraded":"2024-09-16T16:58:21.450179+0000","last_fullsized":"2024-09-16T16:58:21.450179+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.408957+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:57:55.408957+0000","last_peered":"2024-09-16T16:57:55.408957+0000","last_clean":"2024-09-16T16:57:55.408957+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:57:55.408957+0000","last_undegraded":"2024-09-16T16:57:55.408957+0000","last_fullsized":"2024-09-16T16:57:55.408957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"63'224","reported_seq":239,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.242593+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:23.242593+0000","last_peered":"2024-09-16T16:58:23.242593+0000","last_clean":"2024-09-16T16:58:23.242593+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:23.242593+0000","last_undegraded":"2024-09-16T16:58:23.242593+0000","last_fullsized":"2024-09-16T16:58:23.242593+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.437529+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:57:55.437529+0000","last_peered":"2024-09-16T16:57:55.437529+0000","last_clean":"2024-09-16T16:57:55.437529+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:57:55.437529+0000","last_undegraded":"2024-09-16T16:57:55.437529+0000","last_fullsized":"2024-09-16T16:57:55.437529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"63'184","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:58:23.416599+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:23.416599+0000","last_peered":"2024-09-16T16:58:23.416599+0000","last_clean":"2024-09-16T16:58:23.416599+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:23.416599+0000","last_undegraded":"2024-09-16T16:58:23.416599+0000","last_fullsized":"2024-09-16T16:58:23.416599+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T16:57:55.417516+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:57:55.417516+0000","last_peered":"2024-09-16T16:57:55.417516+0000","last_clean":"2024-09-16T16:57:55.417516+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:57:55.417516+0000","last_undegraded":"2024-09-16T16:57:55.417516+0000","last_fullsized":"2024-09-16T16:57:55.417516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":25387008,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3099,"num_write_kb":24792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046646272,"internally_reserved":0,"allocated":164847616,"data_stored":164847616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3099,"ondisk_log_size":3099,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214046654464,"internally_reserved":0,"allocated":164839424,"data_stored":164839424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":43816,"kb_used_data":43816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52253912,"statfs":{"total":53552873472,"available":53508005888,"internally_reserved":0,"allocated":44867584,"data_stored":44867584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34804,"kb_used_data":34804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52262924,"statfs":{"total":53552873472,"available":53517234176,"internally_reserved":0,"allocated":35639296,"data_stored":35639296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":30376,"kb_used_data":30376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52267352,"statfs":{"total":53552873472,"available":53521768448,"internally_reserved":0,"allocated":31105024,"data_stored":31105024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":49012,"kb_used_data":49012,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52248716,"statfs":{"total":53552873472,"available":53502685184,"internally_reserved":0,"allocated":50188288,"data_stored":50188288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53501755392,"internally_reserved":0,"allocated":51118080,"data_stored":51118080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53501747200,"internally_reserved":0,"allocated":51126272,"data_stored":51126272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53521154048,"internally_reserved":0,"allocated":31719424,"data_stored":31719424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53516812288,"internally_reserved":0,"allocated":36061184,"data_stored":36061184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53506932736,"internally_reserved":0,"allocated":45940736,"data_stored":45940736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:47.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 5368 5352 0.788838 0.757812 0.167382 0.158041 2024-09-16T16:58:48.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 5487 5471 0.791445 0.929688 0.097787 0.157671 2024-09-16T16:58:48.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:49.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:49.112+0000 7f5d36f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:49.120+0000 7f5d36f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:49.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 5597 5581 0.792679 0.859375 0.311111 0.157335 2024-09-16T16:58:50.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 5685 5669 0.790799 0.6875 0.227212 0.157649 2024-09-16T16:58:51.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:51.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 5796 5780 0.792138 0.867188 0.0961278 0.157563 2024-09-16T16:58:51.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:51.582+0000 7f723dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:51.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:51.590+0000 7f723dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.184 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:52.184 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:52.184 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:58:52.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:58:52.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:52.317+0000 7f727e46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:52.329+0000 7f727e46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:52.434 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:52.435 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:52.438 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:52.438 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:52.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:58:52.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 5902 5886 0.792757 0.828125 0.227888 0.157458 2024-09-16T16:58:52.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:52.591+0000 7fa46e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:52.605+0000 7fa46e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:52.623 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:52.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:52.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:52.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:58:52.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:52.745+0000 7fc006d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:52.756+0000 7fc006d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:52.856 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:52.857 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:52.857 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:52.860 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:52.860 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:52.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:58:53.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:53.023+0000 7f87c3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:53.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:53.039+0000 7f87c3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:58:53.100 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:58:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:58:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:58:53.101 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:58:53.105 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:58:53.105 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:58:53.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 6000 5984 0.792296 0.765625 0.193393 0.157446 2024-09-16T16:58:53.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:54.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:54.113+0000 7f6e22508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:54.121+0000 7f6e22508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:54.505 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:58:54.505795+0000 min lat: 0.0209942 max lat: 0.948676 avg lat: 0.157434 2024-09-16T16:58:54.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:58:54.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 6106 6090 0.792892 0.828125 0.121465 0.157434 2024-09-16T16:58:55.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 6224 6208 0.795004 0.921875 0.171053 0.157034 2024-09-16T16:58:56.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:58:56.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6314 6298 0.793521 0.703125 0.163563 0.157263 2024-09-16T16:58:56.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:56.567+0000 7f04cacfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:56.576+0000 7f04cacfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:57.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 6413 6397 0.793201 0.773438 0.100896 0.157444 2024-09-16T16:58:58.106 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:58:58.106 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:58:58.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:58:58.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:58.238+0000 7fb229111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:58.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:58.249+0000 7fb229111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:58.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 16 6497 6481 0.79106 0.65625 0.135835 0.157821 2024-09-16T16:58:58.606 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:58:58.606 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:58:58.624 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2024-09-16T16:58:58.503099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50487859,"num_objects":766,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6172,"num_write_kb":49836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6146,"ondisk_log_size":6146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":308168,"kb_used_data":308168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208882744,"statfs":{"total":214211493888,"available":213895929856,"internally_reserved":0,"allocated":315564032,"data_stored":315564032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24510464,"num_objects":374,"num_object_clones":0,"num_object_copies":1122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2992,"num_write_kb":23936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001820"},"pg_stats":[{"pgid":"9.7","version":"72'347","reported_seq":389,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.368042+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:54.368042+0000","last_peered":"2024-09-16T16:58:54.368042+0000","last_clean":"2024-09-16T16:58:54.368042+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:54.368042+0000","last_undegraded":"2024-09-16T16:58:54.368042+0000","last_fullsized":"2024-09-16T16:58:54.368042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842624,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":2776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.761209+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:52.761209+0000","last_peered":"2024-09-16T16:58:52.761209+0000","last_clean":"2024-09-16T16:58:52.761209+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:52.761209+0000","last_undegraded":"2024-09-16T16:58:52.761209+0000","last_fullsized":"2024-09-16T16:58:52.761209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'336","reported_seq":378,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.407215+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:53.407215+0000","last_peered":"2024-09-16T16:58:53.407215+0000","last_clean":"2024-09-16T16:58:53.407215+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:53.407215+0000","last_undegraded":"2024-09-16T16:58:53.407215+0000","last_fullsized":"2024-09-16T16:58:53.407215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.265686+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:54.265686+0000","last_peered":"2024-09-16T16:58:54.265686+0000","last_clean":"2024-09-16T16:58:54.265686+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:54.265686+0000","last_undegraded":"2024-09-16T16:58:54.265686+0000","last_fullsized":"2024-09-16T16:58:54.265686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.450067+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:52.450067+0000","last_peered":"2024-09-16T16:58:52.450067+0000","last_clean":"2024-09-16T16:58:52.450067+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:52.450067+0000","last_undegraded":"2024-09-16T16:58:52.450067+0000","last_fullsized":"2024-09-16T16:58:52.450067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.278853+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:52.278853+0000","last_peered":"2024-09-16T16:58:52.278853+0000","last_clean":"2024-09-16T16:58:52.278853+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:52.278853+0000","last_undegraded":"2024-09-16T16:58:52.278853+0000","last_fullsized":"2024-09-16T16:58:52.278853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.201958+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:53.201958+0000","last_peered":"2024-09-16T16:58:53.201958+0000","last_clean":"2024-09-16T16:58:53.201958+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:53.201958+0000","last_undegraded":"2024-09-16T16:58:53.201958+0000","last_fullsized":"2024-09-16T16:58:53.201958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'328","reported_seq":370,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.339456+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:53.339456+0000","last_peered":"2024-09-16T16:58:53.339456+0000","last_clean":"2024-09-16T16:58:53.339456+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:53.339456+0000","last_undegraded":"2024-09-16T16:58:53.339456+0000","last_fullsized":"2024-09-16T16:58:53.339456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.340367+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:54.340367+0000","last_peered":"2024-09-16T16:58:54.340367+0000","last_clean":"2024-09-16T16:58:54.340367+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:54.340367+0000","last_undegraded":"2024-09-16T16:58:54.340367+0000","last_fullsized":"2024-09-16T16:58:54.340367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'360","reported_seq":402,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.872878+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:53.872878+0000","last_peered":"2024-09-16T16:58:53.872878+0000","last_clean":"2024-09-16T16:58:53.872878+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:53.872878+0000","last_undegraded":"2024-09-16T16:58:53.872878+0000","last_fullsized":"2024-09-16T16:58:53.872878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'440","reported_seq":482,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.091310+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:54.091310+0000","last_peered":"2024-09-16T16:58:54.091310+0000","last_clean":"2024-09-16T16:58:54.091310+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:54.091310+0000","last_undegraded":"2024-09-16T16:58:54.091310+0000","last_fullsized":"2024-09-16T16:58:54.091310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.999140+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:53.999140+0000","last_peered":"2024-09-16T16:58:53.999140+0000","last_clean":"2024-09-16T16:58:53.999140+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:53.999140+0000","last_undegraded":"2024-09-16T16:58:53.999140+0000","last_fullsized":"2024-09-16T16:58:53.999140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'408","reported_seq":450,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.607889+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:52.607889+0000","last_peered":"2024-09-16T16:58:52.607889+0000","last_clean":"2024-09-16T16:58:52.607889+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:52.607889+0000","last_undegraded":"2024-09-16T16:58:52.607889+0000","last_fullsized":"2024-09-16T16:58:52.607889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"71'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.246817+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:52.246817+0000","last_peered":"2024-09-16T16:58:52.246817+0000","last_clean":"2024-09-16T16:58:52.246817+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:52.246817+0000","last_undegraded":"2024-09-16T16:58:52.246817+0000","last_fullsized":"2024-09-16T16:58:52.246817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.803884+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:53.803884+0000","last_peered":"2024-09-16T16:58:53.803884+0000","last_clean":"2024-09-16T16:58:53.803884+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:53.803884+0000","last_undegraded":"2024-09-16T16:58:53.803884+0000","last_fullsized":"2024-09-16T16:58:53.803884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.166957+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:54.166957+0000","last_peered":"2024-09-16T16:58:54.166957+0000","last_clean":"2024-09-16T16:58:54.166957+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:54.166957+0000","last_undegraded":"2024-09-16T16:58:54.166957+0000","last_fullsized":"2024-09-16T16:58:54.166957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":49897472,"num_objects":762,"num_object_clones":0,"num_object_copies":2286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6091,"num_write_kb":48728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6091,"ondisk_log_size":6091,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83944,"kb_used_data":83944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213784,"statfs":{"total":53552873472,"available":53466914816,"internally_reserved":0,"allocated":85958656,"data_stored":85958656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64804,"kb_used_data":64804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232924,"statfs":{"total":53552873472,"available":53486514176,"internally_reserved":0,"allocated":66359296,"data_stored":66359296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63136,"kb_used_data":63136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234592,"statfs":{"total":53552873472,"available":53488222208,"internally_reserved":0,"allocated":64651264,"data_stored":64651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96284,"kb_used_data":96284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52201444,"statfs":{"total":53552873472,"available":53454278656,"internally_reserved":0,"allocated":98594816,"data_stored":98594816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:58:58.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:58:59.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:59.021+0000 7f865647f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:59.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:58:59.027+0000 7f865647f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:58:59.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 6594 6578 0.790548 0.757812 0.15644 0.157907 2024-09-16T16:59:00.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 6685 6669 0.789341 0.710938 0.0492109 0.15804 2024-09-16T16:59:01.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:01.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:01.372+0000 7f2e41ce3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:01.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:01.380+0000 7f2e41ce3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:01.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 6794 6778 0.790268 0.851562 0.168 0.157974 2024-09-16T16:59:02.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 6896 6880 0.790364 0.796875 0.0690787 0.157969 2024-09-16T16:59:03.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 16 7010 6994 0.791816 0.890625 0.315682 0.157507 2024-09-16T16:59:03.626 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:03.626 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:03.626 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:03.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:03.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:03.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:03.749+0000 7f180ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:03.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:03.761+0000 7f180ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:03.787+0000 7fc4e4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:03.796+0000 7fc4e4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:03.842 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:03.843 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:03.843 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:03.843 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:03.843 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:03.845 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:03.845 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:03.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:04.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:04.003+0000 7f64aa0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:04.015+0000 7f64aa0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.091 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:04.092 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:04.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:04.096 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:04.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:04.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:04.271+0000 7f5b5b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:04.283+0000 7f5b5b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.417 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:04.417 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:04.417 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:04.417 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:04.421 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:04.421 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:04.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:04.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 7103 7087 0.790883 0.726562 0.16082 0.157733 2024-09-16T16:59:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:04.583+0000 7fb6d1311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:04.594+0000 7fb6d1311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:04.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:04.618 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:05.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 7202 7186 0.790636 0.773438 0.412281 0.157819 2024-09-16T16:59:06.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:06.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:06.316+0000 7f484f888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:06.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:06.327+0000 7f484f888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:06.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7298 7282 0.790071 0.75 0.138356 0.158062 2024-09-16T16:59:07.506 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 7399 7383 0.790056 0.789062 0.0398204 0.157871 2024-09-16T16:59:08.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 7501 7485 0.790147 0.796875 0.0838484 0.158032 2024-09-16T16:59:08.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:08.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:08.698+0000 7fc7fe49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:08.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:08.705+0000 7fc7fe49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:09.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 7593 7577 0.789195 0.71875 0.217842 0.158212 2024-09-16T16:59:09.618 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:09.619 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:09.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:09.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:09.768+0000 7f5fe3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:09.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:09.780+0000 7f5fe3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:10.021 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:10.036 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-09-16T16:59:08.504983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50487859,"num_objects":766,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6172,"num_write_kb":49836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6146,"ondisk_log_size":6146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":308168,"kb_used_data":308168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208882744,"statfs":{"total":214211493888,"available":213895929856,"internally_reserved":0,"allocated":315564032,"data_stored":315564032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002256"},"pg_stats":[{"pgid":"9.7","version":"72'347","reported_seq":389,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.368042+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:54.368042+0000","last_peered":"2024-09-16T16:58:54.368042+0000","last_clean":"2024-09-16T16:58:54.368042+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:54.368042+0000","last_undegraded":"2024-09-16T16:58:54.368042+0000","last_fullsized":"2024-09-16T16:58:54.368042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842624,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":2776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.761209+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:52.761209+0000","last_peered":"2024-09-16T16:58:52.761209+0000","last_clean":"2024-09-16T16:58:52.761209+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:52.761209+0000","last_undegraded":"2024-09-16T16:58:52.761209+0000","last_fullsized":"2024-09-16T16:58:52.761209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'336","reported_seq":378,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.407215+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:53.407215+0000","last_peered":"2024-09-16T16:58:53.407215+0000","last_clean":"2024-09-16T16:58:53.407215+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:53.407215+0000","last_undegraded":"2024-09-16T16:58:53.407215+0000","last_fullsized":"2024-09-16T16:58:53.407215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.265686+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:54.265686+0000","last_peered":"2024-09-16T16:58:54.265686+0000","last_clean":"2024-09-16T16:58:54.265686+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:54.265686+0000","last_undegraded":"2024-09-16T16:58:54.265686+0000","last_fullsized":"2024-09-16T16:58:54.265686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.450067+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:52.450067+0000","last_peered":"2024-09-16T16:58:52.450067+0000","last_clean":"2024-09-16T16:58:52.450067+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:52.450067+0000","last_undegraded":"2024-09-16T16:58:52.450067+0000","last_fullsized":"2024-09-16T16:58:52.450067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.278853+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:52.278853+0000","last_peered":"2024-09-16T16:58:52.278853+0000","last_clean":"2024-09-16T16:58:52.278853+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:52.278853+0000","last_undegraded":"2024-09-16T16:58:52.278853+0000","last_fullsized":"2024-09-16T16:58:52.278853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.201958+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:53.201958+0000","last_peered":"2024-09-16T16:58:53.201958+0000","last_clean":"2024-09-16T16:58:53.201958+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:53.201958+0000","last_undegraded":"2024-09-16T16:58:53.201958+0000","last_fullsized":"2024-09-16T16:58:53.201958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'328","reported_seq":370,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.339456+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:53.339456+0000","last_peered":"2024-09-16T16:58:53.339456+0000","last_clean":"2024-09-16T16:58:53.339456+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:53.339456+0000","last_undegraded":"2024-09-16T16:58:53.339456+0000","last_fullsized":"2024-09-16T16:58:53.339456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.340367+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:54.340367+0000","last_peered":"2024-09-16T16:58:54.340367+0000","last_clean":"2024-09-16T16:58:54.340367+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:54.340367+0000","last_undegraded":"2024-09-16T16:58:54.340367+0000","last_fullsized":"2024-09-16T16:58:54.340367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'360","reported_seq":402,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.872878+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:53.872878+0000","last_peered":"2024-09-16T16:58:53.872878+0000","last_clean":"2024-09-16T16:58:53.872878+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:53.872878+0000","last_undegraded":"2024-09-16T16:58:53.872878+0000","last_fullsized":"2024-09-16T16:58:53.872878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'440","reported_seq":482,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.091310+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:54.091310+0000","last_peered":"2024-09-16T16:58:54.091310+0000","last_clean":"2024-09-16T16:58:54.091310+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:54.091310+0000","last_undegraded":"2024-09-16T16:58:54.091310+0000","last_fullsized":"2024-09-16T16:58:54.091310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.999140+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:53.999140+0000","last_peered":"2024-09-16T16:58:53.999140+0000","last_clean":"2024-09-16T16:58:53.999140+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:53.999140+0000","last_undegraded":"2024-09-16T16:58:53.999140+0000","last_fullsized":"2024-09-16T16:58:53.999140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'408","reported_seq":450,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.607889+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:52.607889+0000","last_peered":"2024-09-16T16:58:52.607889+0000","last_clean":"2024-09-16T16:58:52.607889+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:52.607889+0000","last_undegraded":"2024-09-16T16:58:52.607889+0000","last_fullsized":"2024-09-16T16:58:52.607889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"71'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.246817+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:52.246817+0000","last_peered":"2024-09-16T16:58:52.246817+0000","last_clean":"2024-09-16T16:58:52.246817+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:52.246817+0000","last_undegraded":"2024-09-16T16:58:52.246817+0000","last_fullsized":"2024-09-16T16:58:52.246817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.803884+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:53.803884+0000","last_peered":"2024-09-16T16:58:53.803884+0000","last_clean":"2024-09-16T16:58:53.803884+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:53.803884+0000","last_undegraded":"2024-09-16T16:58:53.803884+0000","last_fullsized":"2024-09-16T16:58:53.803884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.166957+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:54.166957+0000","last_peered":"2024-09-16T16:58:54.166957+0000","last_clean":"2024-09-16T16:58:54.166957+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:54.166957+0000","last_undegraded":"2024-09-16T16:58:54.166957+0000","last_fullsized":"2024-09-16T16:58:54.166957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":49897472,"num_objects":762,"num_object_clones":0,"num_object_copies":2286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6091,"num_write_kb":48728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6091,"ondisk_log_size":6091,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83944,"kb_used_data":83944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213784,"statfs":{"total":53552873472,"available":53466914816,"internally_reserved":0,"allocated":85958656,"data_stored":85958656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64804,"kb_used_data":64804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232924,"statfs":{"total":53552873472,"available":53486514176,"internally_reserved":0,"allocated":66359296,"data_stored":66359296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63136,"kb_used_data":63136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234592,"statfs":{"total":53552873472,"available":53488222208,"internally_reserved":0,"allocated":64651264,"data_stored":64651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96284,"kb_used_data":96284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52201444,"statfs":{"total":53552873472,"available":53454278656,"internally_reserved":0,"allocated":98594816,"data_stored":98594816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:10.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 7695 7679 0.789294 0.796875 0.349455 0.158044 2024-09-16T16:59:11.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:11.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:11.133+0000 7f2d8c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:11.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:11.141+0000 7f2d8c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:11.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 7789 7773 0.78858 0.734375 0.127725 0.158392 2024-09-16T16:59:12.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 7888 7872 0.788385 0.773438 0.184561 0.158342 2024-09-16T16:59:13.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:13.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 7985 7969 0.787997 0.757812 0.0876893 0.158398 2024-09-16T16:59:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:13.640+0000 7f34d1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:13.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:13.649+0000 7f34d1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:14.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T16:59:14.507677+0000 min lat: 0.0209942 max lat: 0.948676 avg lat: 0.158411 2024-09-16T16:59:14.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:59:14.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 8089 8073 0.788303 0.8125 0.166999 0.158411 2024-09-16T16:59:15.039 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:15.039 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:15.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:15.220+0000 7f9b35888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:15.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:15.235+0000 7f9b35888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:15.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 8188 8172 0.788118 0.773438 0.216933 0.158323 2024-09-16T16:59:15.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:15.521 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:15.544 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":433,"stamp":"2024-09-16T16:59:14.505995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50487859,"num_objects":766,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6172,"num_write_kb":49836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6146,"ondisk_log_size":6146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":308168,"kb_used_data":308168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208882744,"statfs":{"total":214211493888,"available":213895929856,"internally_reserved":0,"allocated":315564032,"data_stored":315564032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002087"},"pg_stats":[{"pgid":"9.7","version":"72'347","reported_seq":389,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.368042+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:54.368042+0000","last_peered":"2024-09-16T16:58:54.368042+0000","last_clean":"2024-09-16T16:58:54.368042+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:54.368042+0000","last_undegraded":"2024-09-16T16:58:54.368042+0000","last_fullsized":"2024-09-16T16:58:54.368042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842624,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":2776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.761209+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:52.761209+0000","last_peered":"2024-09-16T16:58:52.761209+0000","last_clean":"2024-09-16T16:58:52.761209+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:52.761209+0000","last_undegraded":"2024-09-16T16:58:52.761209+0000","last_fullsized":"2024-09-16T16:58:52.761209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'336","reported_seq":378,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.407215+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:53.407215+0000","last_peered":"2024-09-16T16:58:53.407215+0000","last_clean":"2024-09-16T16:58:53.407215+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:53.407215+0000","last_undegraded":"2024-09-16T16:58:53.407215+0000","last_fullsized":"2024-09-16T16:58:53.407215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.265686+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:54.265686+0000","last_peered":"2024-09-16T16:58:54.265686+0000","last_clean":"2024-09-16T16:58:54.265686+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:54.265686+0000","last_undegraded":"2024-09-16T16:58:54.265686+0000","last_fullsized":"2024-09-16T16:58:54.265686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.450067+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:52.450067+0000","last_peered":"2024-09-16T16:58:52.450067+0000","last_clean":"2024-09-16T16:58:52.450067+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:52.450067+0000","last_undegraded":"2024-09-16T16:58:52.450067+0000","last_fullsized":"2024-09-16T16:58:52.450067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.278853+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:52.278853+0000","last_peered":"2024-09-16T16:58:52.278853+0000","last_clean":"2024-09-16T16:58:52.278853+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:52.278853+0000","last_undegraded":"2024-09-16T16:58:52.278853+0000","last_fullsized":"2024-09-16T16:58:52.278853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.201958+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:53.201958+0000","last_peered":"2024-09-16T16:58:53.201958+0000","last_clean":"2024-09-16T16:58:53.201958+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:53.201958+0000","last_undegraded":"2024-09-16T16:58:53.201958+0000","last_fullsized":"2024-09-16T16:58:53.201958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'328","reported_seq":370,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.339456+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:53.339456+0000","last_peered":"2024-09-16T16:58:53.339456+0000","last_clean":"2024-09-16T16:58:53.339456+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:53.339456+0000","last_undegraded":"2024-09-16T16:58:53.339456+0000","last_fullsized":"2024-09-16T16:58:53.339456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.340367+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:54.340367+0000","last_peered":"2024-09-16T16:58:54.340367+0000","last_clean":"2024-09-16T16:58:54.340367+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:54.340367+0000","last_undegraded":"2024-09-16T16:58:54.340367+0000","last_fullsized":"2024-09-16T16:58:54.340367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'360","reported_seq":402,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.872878+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:53.872878+0000","last_peered":"2024-09-16T16:58:53.872878+0000","last_clean":"2024-09-16T16:58:53.872878+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:53.872878+0000","last_undegraded":"2024-09-16T16:58:53.872878+0000","last_fullsized":"2024-09-16T16:58:53.872878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'440","reported_seq":482,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.091310+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:54.091310+0000","last_peered":"2024-09-16T16:58:54.091310+0000","last_clean":"2024-09-16T16:58:54.091310+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:54.091310+0000","last_undegraded":"2024-09-16T16:58:54.091310+0000","last_fullsized":"2024-09-16T16:58:54.091310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.999140+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:53.999140+0000","last_peered":"2024-09-16T16:58:53.999140+0000","last_clean":"2024-09-16T16:58:53.999140+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:53.999140+0000","last_undegraded":"2024-09-16T16:58:53.999140+0000","last_fullsized":"2024-09-16T16:58:53.999140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'408","reported_seq":450,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.607889+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:52.607889+0000","last_peered":"2024-09-16T16:58:52.607889+0000","last_clean":"2024-09-16T16:58:52.607889+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:52.607889+0000","last_undegraded":"2024-09-16T16:58:52.607889+0000","last_fullsized":"2024-09-16T16:58:52.607889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"71'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.246817+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:52.246817+0000","last_peered":"2024-09-16T16:58:52.246817+0000","last_clean":"2024-09-16T16:58:52.246817+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:52.246817+0000","last_undegraded":"2024-09-16T16:58:52.246817+0000","last_fullsized":"2024-09-16T16:58:52.246817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.803884+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:53.803884+0000","last_peered":"2024-09-16T16:58:53.803884+0000","last_clean":"2024-09-16T16:58:53.803884+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:53.803884+0000","last_undegraded":"2024-09-16T16:58:53.803884+0000","last_fullsized":"2024-09-16T16:58:53.803884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.166957+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:54.166957+0000","last_peered":"2024-09-16T16:58:54.166957+0000","last_clean":"2024-09-16T16:58:54.166957+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:54.166957+0000","last_undegraded":"2024-09-16T16:58:54.166957+0000","last_fullsized":"2024-09-16T16:58:54.166957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":49897472,"num_objects":762,"num_object_clones":0,"num_object_copies":2286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6091,"num_write_kb":48728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6091,"ondisk_log_size":6091,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83944,"kb_used_data":83944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213784,"statfs":{"total":53552873472,"available":53466914816,"internally_reserved":0,"allocated":85958656,"data_stored":85958656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64804,"kb_used_data":64804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232924,"statfs":{"total":53552873472,"available":53486514176,"internally_reserved":0,"allocated":66359296,"data_stored":66359296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63136,"kb_used_data":63136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234592,"statfs":{"total":53552873472,"available":53488222208,"internally_reserved":0,"allocated":64651264,"data_stored":64651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96284,"kb_used_data":96284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52201444,"statfs":{"total":53552873472,"available":53454278656,"internally_reserved":0,"allocated":98594816,"data_stored":98594816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:15.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:16.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:16.127+0000 7fbccac57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:16.135+0000 7fbccac57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:16.507 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 16 8297 8281 0.788891 0.851562 0.106487 0.158331 2024-09-16T16:59:17.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 8396 8380 0.788704 0.773438 0.212704 0.158229 2024-09-16T16:59:18.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:18.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 8498 8482 0.7888 0.796875 0.0640469 0.15833 2024-09-16T16:59:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:18.636+0000 7f70a4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:18.644+0000 7f70a4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:19.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 8619 8603 0.79064 0.945312 0.149216 0.157926 2024-09-16T16:59:20.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 8714 8698 0.790076 0.742188 0.138012 0.158049 2024-09-16T16:59:20.546 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:20.546 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:20.547 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:20.685+0000 7fc842a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:20.697+0000 7fc842a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:21.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:21.058 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:21.059 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:21.078 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-09-16T16:59:20.507264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50487859,"num_objects":766,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6172,"num_write_kb":49836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6146,"ondisk_log_size":6146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":308168,"kb_used_data":308168,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208882744,"statfs":{"total":214211493888,"available":213895929856,"internally_reserved":0,"allocated":315564032,"data_stored":315564032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002280"},"pg_stats":[{"pgid":"9.7","version":"72'347","reported_seq":389,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.368042+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:58:54.368042+0000","last_peered":"2024-09-16T16:58:54.368042+0000","last_clean":"2024-09-16T16:58:54.368042+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:58:54.368042+0000","last_undegraded":"2024-09-16T16:58:54.368042+0000","last_fullsized":"2024-09-16T16:58:54.368042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842624,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":2776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.761209+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:58:52.761209+0000","last_peered":"2024-09-16T16:58:52.761209+0000","last_clean":"2024-09-16T16:58:52.761209+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:58:52.761209+0000","last_undegraded":"2024-09-16T16:58:52.761209+0000","last_fullsized":"2024-09-16T16:58:52.761209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'336","reported_seq":378,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.407215+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:58:53.407215+0000","last_peered":"2024-09-16T16:58:53.407215+0000","last_clean":"2024-09-16T16:58:53.407215+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:58:53.407215+0000","last_undegraded":"2024-09-16T16:58:53.407215+0000","last_fullsized":"2024-09-16T16:58:53.407215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.265686+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:58:54.265686+0000","last_peered":"2024-09-16T16:58:54.265686+0000","last_clean":"2024-09-16T16:58:54.265686+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:58:54.265686+0000","last_undegraded":"2024-09-16T16:58:54.265686+0000","last_fullsized":"2024-09-16T16:58:54.265686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.450067+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:58:52.450067+0000","last_peered":"2024-09-16T16:58:52.450067+0000","last_clean":"2024-09-16T16:58:52.450067+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:58:52.450067+0000","last_undegraded":"2024-09-16T16:58:52.450067+0000","last_fullsized":"2024-09-16T16:58:52.450067+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.278853+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:58:52.278853+0000","last_peered":"2024-09-16T16:58:52.278853+0000","last_clean":"2024-09-16T16:58:52.278853+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:58:52.278853+0000","last_undegraded":"2024-09-16T16:58:52.278853+0000","last_fullsized":"2024-09-16T16:58:52.278853+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.201958+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:58:53.201958+0000","last_peered":"2024-09-16T16:58:53.201958+0000","last_clean":"2024-09-16T16:58:53.201958+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:58:53.201958+0000","last_undegraded":"2024-09-16T16:58:53.201958+0000","last_fullsized":"2024-09-16T16:58:53.201958+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'328","reported_seq":370,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.339456+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:58:53.339456+0000","last_peered":"2024-09-16T16:58:53.339456+0000","last_clean":"2024-09-16T16:58:53.339456+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:58:53.339456+0000","last_undegraded":"2024-09-16T16:58:53.339456+0000","last_fullsized":"2024-09-16T16:58:53.339456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.340367+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:58:54.340367+0000","last_peered":"2024-09-16T16:58:54.340367+0000","last_clean":"2024-09-16T16:58:54.340367+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:58:54.340367+0000","last_undegraded":"2024-09-16T16:58:54.340367+0000","last_fullsized":"2024-09-16T16:58:54.340367+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'360","reported_seq":402,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.872878+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:58:53.872878+0000","last_peered":"2024-09-16T16:58:53.872878+0000","last_clean":"2024-09-16T16:58:53.872878+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:58:53.872878+0000","last_undegraded":"2024-09-16T16:58:53.872878+0000","last_fullsized":"2024-09-16T16:58:53.872878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'440","reported_seq":482,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.091310+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:58:54.091310+0000","last_peered":"2024-09-16T16:58:54.091310+0000","last_clean":"2024-09-16T16:58:54.091310+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:58:54.091310+0000","last_undegraded":"2024-09-16T16:58:54.091310+0000","last_fullsized":"2024-09-16T16:58:54.091310+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'416","reported_seq":458,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.999140+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:58:53.999140+0000","last_peered":"2024-09-16T16:58:53.999140+0000","last_clean":"2024-09-16T16:58:53.999140+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:58:53.999140+0000","last_undegraded":"2024-09-16T16:58:53.999140+0000","last_fullsized":"2024-09-16T16:58:53.999140+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'408","reported_seq":450,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.607889+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:58:52.607889+0000","last_peered":"2024-09-16T16:58:52.607889+0000","last_clean":"2024-09-16T16:58:52.607889+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:58:52.607889+0000","last_undegraded":"2024-09-16T16:58:52.607889+0000","last_fullsized":"2024-09-16T16:58:52.607889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"71'400","reported_seq":442,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.246817+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:58:52.246817+0000","last_peered":"2024-09-16T16:58:52.246817+0000","last_clean":"2024-09-16T16:58:52.246817+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:58:52.246817+0000","last_undegraded":"2024-09-16T16:58:52.246817+0000","last_fullsized":"2024-09-16T16:58:52.246817+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'344","reported_seq":386,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:53.803884+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:58:53.803884+0000","last_peered":"2024-09-16T16:58:53.803884+0000","last_clean":"2024-09-16T16:58:53.803884+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:58:53.803884+0000","last_undegraded":"2024-09-16T16:58:53.803884+0000","last_fullsized":"2024-09-16T16:58:53.803884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'384","reported_seq":426,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:54.166957+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:58:54.166957+0000","last_peered":"2024-09-16T16:58:54.166957+0000","last_clean":"2024-09-16T16:58:54.166957+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:58:54.166957+0000","last_undegraded":"2024-09-16T16:58:54.166957+0000","last_fullsized":"2024-09-16T16:58:54.166957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":49897472,"num_objects":762,"num_object_clones":0,"num_object_copies":2286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6091,"num_write_kb":48728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6091,"ondisk_log_size":6091,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213892902912,"internally_reserved":0,"allocated":318590976,"data_stored":318590976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":83944,"kb_used_data":83944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52213784,"statfs":{"total":53552873472,"available":53466914816,"internally_reserved":0,"allocated":85958656,"data_stored":85958656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":64804,"kb_used_data":64804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52232924,"statfs":{"total":53552873472,"available":53486514176,"internally_reserved":0,"allocated":66359296,"data_stored":66359296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":63136,"kb_used_data":63136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52234592,"statfs":{"total":53552873472,"available":53488222208,"internally_reserved":0,"allocated":64651264,"data_stored":64651264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96284,"kb_used_data":96284,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52201444,"statfs":{"total":53552873472,"available":53454278656,"internally_reserved":0,"allocated":98594816,"data_stored":98594816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53465563136,"internally_reserved":0,"allocated":87310336,"data_stored":87310336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53453570048,"internally_reserved":0,"allocated":99303424,"data_stored":99303424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53487632384,"internally_reserved":0,"allocated":65241088,"data_stored":65241088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53486145536,"internally_reserved":0,"allocated":66727936,"data_stored":66727936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53465554944,"internally_reserved":0,"allocated":87318528,"data_stored":87318528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:21.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:21.165+0000 7fdf2bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:21.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:21.177+0000 7fdf2bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:21.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 8802 8786 0.788897 0.6875 0.233406 0.1582 2024-09-16T16:59:22.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 16 8889 8873 0.787655 0.679688 0.131378 0.158522 2024-09-16T16:59:23.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:23.508 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 8971 8955 0.786002 0.640625 0.236416 0.158829 2024-09-16T16:59:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:23.573+0000 7ff239f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:23.584+0000 7ff239f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:24.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 15 9075 9060 0.786381 0.820312 0.26559 0.158793 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.095 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 9075 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.786929 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.0977747 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 1 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.515625 2024-09-16T16:59:25.509 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 100 2024-09-16T16:59:25.510 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 12.5152 2024-09-16T16:59:25.510 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 128 2024-09-16T16:59:25.510 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 66 2024-09-16T16:59:25.510 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.15876 2024-09-16T16:59:25.510 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.0931715 2024-09-16T16:59:25.510 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 0.948676 2024-09-16T16:59:25.510 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0209942 2024-09-16T16:59:25.549 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T16:59:25.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:25.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:25.937+0000 7fed43391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:25.946+0000 7fed43391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:26.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:26.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T16:59:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:26.230+0000 7f4607b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:26.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:26.245+0000 7f4607b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T16:59:27.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T16:59:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:27.371+0000 7f03fe89c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:27.385+0000 7f03fe89c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:28.167 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T16:59:28.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T16:59:28.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:28.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:28.361+0000 7fe13ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:28.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:28.377+0000 7fe13ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:28.426+0000 7fe4cbb08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:28.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:28.438+0000 7fe4ca8a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T16:59:29.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T16:59:29.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:29.339+0000 7ff274151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:29.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:29.354+0000 7ff274151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.177 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T16:59:30.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T16:59:30.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:30.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:30.363+0000 7fa972391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:30.376+0000 7fa972391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.653 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:30.654 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:30.676 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-09-16T16:59:30.509167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":74818099,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9142,"num_write_kb":73596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9116,"ondisk_log_size":9116,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":456944,"kb_used_data":456944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208733968,"statfs":{"total":214211493888,"available":213743583232,"internally_reserved":0,"allocated":467910656,"data_stored":467910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000763"},"pg_stats":[{"pgid":"9.7","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.839539+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:59:23.839539+0000","last_peered":"2024-09-16T16:59:23.839539+0000","last_clean":"2024-09-16T16:59:23.839539+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:59:23.839539+0000","last_undegraded":"2024-09-16T16:59:23.839539+0000","last_fullsized":"2024-09-16T16:59:23.839539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'624","reported_seq":666,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.140304+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:59:24.140304+0000","last_peered":"2024-09-16T16:59:24.140304+0000","last_clean":"2024-09-16T16:59:24.140304+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:59:24.140304+0000","last_undegraded":"2024-09-16T16:59:24.140304+0000","last_fullsized":"2024-09-16T16:59:24.140304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.075368+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:59:24.075368+0000","last_peered":"2024-09-16T16:59:24.075368+0000","last_clean":"2024-09-16T16:59:24.075368+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:59:24.075368+0000","last_undegraded":"2024-09-16T16:59:24.075368+0000","last_fullsized":"2024-09-16T16:59:24.075368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'616","reported_seq":658,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.039668+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:59:23.039668+0000","last_peered":"2024-09-16T16:59:23.039668+0000","last_clean":"2024-09-16T16:59:23.039668+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:59:23.039668+0000","last_undegraded":"2024-09-16T16:59:23.039668+0000","last_fullsized":"2024-09-16T16:59:23.039668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.116805+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:59:22.116805+0000","last_peered":"2024-09-16T16:59:22.116805+0000","last_clean":"2024-09-16T16:59:22.116805+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:59:22.116805+0000","last_undegraded":"2024-09-16T16:59:22.116805+0000","last_fullsized":"2024-09-16T16:59:22.116805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'533","reported_seq":575,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.393917+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:59:24.393917+0000","last_peered":"2024-09-16T16:59:24.393917+0000","last_clean":"2024-09-16T16:59:24.393917+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:59:24.393917+0000","last_undegraded":"2024-09-16T16:59:24.393917+0000","last_fullsized":"2024-09-16T16:59:24.393917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4366336,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.933990+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:59:22.933990+0000","last_peered":"2024-09-16T16:59:22.933990+0000","last_clean":"2024-09-16T16:59:22.933990+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:59:22.933990+0000","last_undegraded":"2024-09-16T16:59:22.933990+0000","last_fullsized":"2024-09-16T16:59:22.933990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.114783+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:59:23.114783+0000","last_peered":"2024-09-16T16:59:23.114783+0000","last_clean":"2024-09-16T16:59:23.114783+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:59:23.114783+0000","last_undegraded":"2024-09-16T16:59:23.114783+0000","last_fullsized":"2024-09-16T16:59:23.114783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'576","reported_seq":618,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:19.276183+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:59:19.276183+0000","last_peered":"2024-09-16T16:59:19.276183+0000","last_clean":"2024-09-16T16:59:19.276183+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:59:19.276183+0000","last_undegraded":"2024-09-16T16:59:19.276183+0000","last_fullsized":"2024-09-16T16:59:19.276183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.334567+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:59:24.334567+0000","last_peered":"2024-09-16T16:59:24.334567+0000","last_clean":"2024-09-16T16:59:24.334567+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:59:24.334567+0000","last_undegraded":"2024-09-16T16:59:24.334567+0000","last_fullsized":"2024-09-16T16:59:24.334567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.741461+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:59:23.741461+0000","last_peered":"2024-09-16T16:59:23.741461+0000","last_clean":"2024-09-16T16:59:23.741461+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:59:23.741461+0000","last_undegraded":"2024-09-16T16:59:23.741461+0000","last_fullsized":"2024-09-16T16:59:23.741461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'640","reported_seq":682,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.578816+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:59:22.578816+0000","last_peered":"2024-09-16T16:59:22.578816+0000","last_clean":"2024-09-16T16:59:22.578816+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:59:22.578816+0000","last_undegraded":"2024-09-16T16:59:22.578816+0000","last_fullsized":"2024-09-16T16:59:22.578816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.274816+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:59:24.274816+0000","last_peered":"2024-09-16T16:59:24.274816+0000","last_clean":"2024-09-16T16:59:24.274816+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:59:24.274816+0000","last_undegraded":"2024-09-16T16:59:24.274816+0000","last_fullsized":"2024-09-16T16:59:24.274816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"72'544","reported_seq":586,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.683475+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:59:22.683475+0000","last_peered":"2024-09-16T16:59:22.683475+0000","last_clean":"2024-09-16T16:59:22.683475+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:59:22.683475+0000","last_undegraded":"2024-09-16T16:59:22.683475+0000","last_fullsized":"2024-09-16T16:59:22.683475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'512","reported_seq":554,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.185924+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:59:24.185924+0000","last_peered":"2024-09-16T16:59:24.185924+0000","last_clean":"2024-09-16T16:59:24.185924+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:59:24.185924+0000","last_undegraded":"2024-09-16T16:59:24.185924+0000","last_fullsized":"2024-09-16T16:59:24.185924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'536","reported_seq":578,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.904937+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:59:23.904937+0000","last_peered":"2024-09-16T16:59:23.904937+0000","last_clean":"2024-09-16T16:59:23.904937+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:59:23.904937+0000","last_undegraded":"2024-09-16T16:59:23.904937+0000","last_fullsized":"2024-09-16T16:59:23.904937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":74227712,"num_objects":1133,"num_object_clones":0,"num_object_copies":3399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9061,"num_write_kb":72488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740818432,"internally_reserved":0,"allocated":470675456,"data_stored":470675456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9061,"ondisk_log_size":9061,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740826624,"internally_reserved":0,"allocated":470667264,"data_stored":470667264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124704,"kb_used_data":124704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173024,"statfs":{"total":53552873472,"available":53425176576,"internally_reserved":0,"allocated":127696896,"data_stored":127696896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96996,"kb_used_data":96996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200732,"statfs":{"total":53552873472,"available":53453549568,"internally_reserved":0,"allocated":99323904,"data_stored":99323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93340,"kb_used_data":93340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204388,"statfs":{"total":53552873472,"available":53457293312,"internally_reserved":0,"allocated":95580160,"data_stored":95580160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":141904,"kb_used_data":141904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52155824,"statfs":{"total":53552873472,"available":53407563776,"internally_reserved":0,"allocated":145309696,"data_stored":145309696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53406994432,"internally_reserved":0,"allocated":145879040,"data_stored":145879040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53406986240,"internally_reserved":0,"allocated":145887232,"data_stored":145887232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:30.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:30.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:30.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:30.838+0000 7ffa60674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:30.854+0000 7ffa60674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:30.866+0000 7fa8f6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:30.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:30.877+0000 7fa8f6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:31.243 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:31.244 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:31.271 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-09-16T16:59:30.509167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":74818099,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9142,"num_write_kb":73596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9116,"ondisk_log_size":9116,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":456944,"kb_used_data":456944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208733968,"statfs":{"total":214211493888,"available":213743583232,"internally_reserved":0,"allocated":467910656,"data_stored":467910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000763"},"pg_stats":[{"pgid":"9.7","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.839539+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:59:23.839539+0000","last_peered":"2024-09-16T16:59:23.839539+0000","last_clean":"2024-09-16T16:59:23.839539+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:59:23.839539+0000","last_undegraded":"2024-09-16T16:59:23.839539+0000","last_fullsized":"2024-09-16T16:59:23.839539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'624","reported_seq":666,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.140304+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:59:24.140304+0000","last_peered":"2024-09-16T16:59:24.140304+0000","last_clean":"2024-09-16T16:59:24.140304+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:59:24.140304+0000","last_undegraded":"2024-09-16T16:59:24.140304+0000","last_fullsized":"2024-09-16T16:59:24.140304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.075368+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:59:24.075368+0000","last_peered":"2024-09-16T16:59:24.075368+0000","last_clean":"2024-09-16T16:59:24.075368+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:59:24.075368+0000","last_undegraded":"2024-09-16T16:59:24.075368+0000","last_fullsized":"2024-09-16T16:59:24.075368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'616","reported_seq":658,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.039668+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:59:23.039668+0000","last_peered":"2024-09-16T16:59:23.039668+0000","last_clean":"2024-09-16T16:59:23.039668+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:59:23.039668+0000","last_undegraded":"2024-09-16T16:59:23.039668+0000","last_fullsized":"2024-09-16T16:59:23.039668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.116805+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:59:22.116805+0000","last_peered":"2024-09-16T16:59:22.116805+0000","last_clean":"2024-09-16T16:59:22.116805+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:59:22.116805+0000","last_undegraded":"2024-09-16T16:59:22.116805+0000","last_fullsized":"2024-09-16T16:59:22.116805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'533","reported_seq":575,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.393917+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:59:24.393917+0000","last_peered":"2024-09-16T16:59:24.393917+0000","last_clean":"2024-09-16T16:59:24.393917+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:59:24.393917+0000","last_undegraded":"2024-09-16T16:59:24.393917+0000","last_fullsized":"2024-09-16T16:59:24.393917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4366336,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.933990+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:59:22.933990+0000","last_peered":"2024-09-16T16:59:22.933990+0000","last_clean":"2024-09-16T16:59:22.933990+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:59:22.933990+0000","last_undegraded":"2024-09-16T16:59:22.933990+0000","last_fullsized":"2024-09-16T16:59:22.933990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.114783+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:59:23.114783+0000","last_peered":"2024-09-16T16:59:23.114783+0000","last_clean":"2024-09-16T16:59:23.114783+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:59:23.114783+0000","last_undegraded":"2024-09-16T16:59:23.114783+0000","last_fullsized":"2024-09-16T16:59:23.114783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'576","reported_seq":618,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:19.276183+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:59:19.276183+0000","last_peered":"2024-09-16T16:59:19.276183+0000","last_clean":"2024-09-16T16:59:19.276183+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:59:19.276183+0000","last_undegraded":"2024-09-16T16:59:19.276183+0000","last_fullsized":"2024-09-16T16:59:19.276183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.334567+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:59:24.334567+0000","last_peered":"2024-09-16T16:59:24.334567+0000","last_clean":"2024-09-16T16:59:24.334567+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:59:24.334567+0000","last_undegraded":"2024-09-16T16:59:24.334567+0000","last_fullsized":"2024-09-16T16:59:24.334567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.741461+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:59:23.741461+0000","last_peered":"2024-09-16T16:59:23.741461+0000","last_clean":"2024-09-16T16:59:23.741461+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:59:23.741461+0000","last_undegraded":"2024-09-16T16:59:23.741461+0000","last_fullsized":"2024-09-16T16:59:23.741461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'640","reported_seq":682,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.578816+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:59:22.578816+0000","last_peered":"2024-09-16T16:59:22.578816+0000","last_clean":"2024-09-16T16:59:22.578816+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:59:22.578816+0000","last_undegraded":"2024-09-16T16:59:22.578816+0000","last_fullsized":"2024-09-16T16:59:22.578816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.274816+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:59:24.274816+0000","last_peered":"2024-09-16T16:59:24.274816+0000","last_clean":"2024-09-16T16:59:24.274816+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:59:24.274816+0000","last_undegraded":"2024-09-16T16:59:24.274816+0000","last_fullsized":"2024-09-16T16:59:24.274816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"72'544","reported_seq":586,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.683475+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:59:22.683475+0000","last_peered":"2024-09-16T16:59:22.683475+0000","last_clean":"2024-09-16T16:59:22.683475+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:59:22.683475+0000","last_undegraded":"2024-09-16T16:59:22.683475+0000","last_fullsized":"2024-09-16T16:59:22.683475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'512","reported_seq":554,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.185924+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:59:24.185924+0000","last_peered":"2024-09-16T16:59:24.185924+0000","last_clean":"2024-09-16T16:59:24.185924+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:59:24.185924+0000","last_undegraded":"2024-09-16T16:59:24.185924+0000","last_fullsized":"2024-09-16T16:59:24.185924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'536","reported_seq":578,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.904937+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:59:23.904937+0000","last_peered":"2024-09-16T16:59:23.904937+0000","last_clean":"2024-09-16T16:59:23.904937+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:59:23.904937+0000","last_undegraded":"2024-09-16T16:59:23.904937+0000","last_fullsized":"2024-09-16T16:59:23.904937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":74227712,"num_objects":1133,"num_object_clones":0,"num_object_copies":3399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9061,"num_write_kb":72488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740818432,"internally_reserved":0,"allocated":470675456,"data_stored":470675456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9061,"ondisk_log_size":9061,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740826624,"internally_reserved":0,"allocated":470667264,"data_stored":470667264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124704,"kb_used_data":124704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173024,"statfs":{"total":53552873472,"available":53425176576,"internally_reserved":0,"allocated":127696896,"data_stored":127696896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96996,"kb_used_data":96996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200732,"statfs":{"total":53552873472,"available":53453549568,"internally_reserved":0,"allocated":99323904,"data_stored":99323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93340,"kb_used_data":93340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204388,"statfs":{"total":53552873472,"available":53457293312,"internally_reserved":0,"allocated":95580160,"data_stored":95580160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":141904,"kb_used_data":141904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52155824,"statfs":{"total":53552873472,"available":53407563776,"internally_reserved":0,"allocated":145309696,"data_stored":145309696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53406994432,"internally_reserved":0,"allocated":145879040,"data_stored":145879040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53406986240,"internally_reserved":0,"allocated":145887232,"data_stored":145887232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:31.272 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T16:59:31.272 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:31.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:31.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:31.461+0000 7f4a30591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:31.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:31.475+0000 7f4a30591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:31.816 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:31.817 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:31.845 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-09-16T16:59:30.509167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":74818099,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9142,"num_write_kb":73596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9116,"ondisk_log_size":9116,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":456944,"kb_used_data":456944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208733968,"statfs":{"total":214211493888,"available":213743583232,"internally_reserved":0,"allocated":467910656,"data_stored":467910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000763"},"pg_stats":[{"pgid":"9.7","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.839539+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:59:23.839539+0000","last_peered":"2024-09-16T16:59:23.839539+0000","last_clean":"2024-09-16T16:59:23.839539+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:59:23.839539+0000","last_undegraded":"2024-09-16T16:59:23.839539+0000","last_fullsized":"2024-09-16T16:59:23.839539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'624","reported_seq":666,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.140304+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:59:24.140304+0000","last_peered":"2024-09-16T16:59:24.140304+0000","last_clean":"2024-09-16T16:59:24.140304+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:59:24.140304+0000","last_undegraded":"2024-09-16T16:59:24.140304+0000","last_fullsized":"2024-09-16T16:59:24.140304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.075368+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:59:24.075368+0000","last_peered":"2024-09-16T16:59:24.075368+0000","last_clean":"2024-09-16T16:59:24.075368+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:59:24.075368+0000","last_undegraded":"2024-09-16T16:59:24.075368+0000","last_fullsized":"2024-09-16T16:59:24.075368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'616","reported_seq":658,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.039668+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:59:23.039668+0000","last_peered":"2024-09-16T16:59:23.039668+0000","last_clean":"2024-09-16T16:59:23.039668+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:59:23.039668+0000","last_undegraded":"2024-09-16T16:59:23.039668+0000","last_fullsized":"2024-09-16T16:59:23.039668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.116805+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:59:22.116805+0000","last_peered":"2024-09-16T16:59:22.116805+0000","last_clean":"2024-09-16T16:59:22.116805+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:59:22.116805+0000","last_undegraded":"2024-09-16T16:59:22.116805+0000","last_fullsized":"2024-09-16T16:59:22.116805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'533","reported_seq":575,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.393917+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:59:24.393917+0000","last_peered":"2024-09-16T16:59:24.393917+0000","last_clean":"2024-09-16T16:59:24.393917+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:59:24.393917+0000","last_undegraded":"2024-09-16T16:59:24.393917+0000","last_fullsized":"2024-09-16T16:59:24.393917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4366336,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.933990+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:59:22.933990+0000","last_peered":"2024-09-16T16:59:22.933990+0000","last_clean":"2024-09-16T16:59:22.933990+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:59:22.933990+0000","last_undegraded":"2024-09-16T16:59:22.933990+0000","last_fullsized":"2024-09-16T16:59:22.933990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.114783+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:59:23.114783+0000","last_peered":"2024-09-16T16:59:23.114783+0000","last_clean":"2024-09-16T16:59:23.114783+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:59:23.114783+0000","last_undegraded":"2024-09-16T16:59:23.114783+0000","last_fullsized":"2024-09-16T16:59:23.114783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'576","reported_seq":618,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:19.276183+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:59:19.276183+0000","last_peered":"2024-09-16T16:59:19.276183+0000","last_clean":"2024-09-16T16:59:19.276183+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:59:19.276183+0000","last_undegraded":"2024-09-16T16:59:19.276183+0000","last_fullsized":"2024-09-16T16:59:19.276183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.334567+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:59:24.334567+0000","last_peered":"2024-09-16T16:59:24.334567+0000","last_clean":"2024-09-16T16:59:24.334567+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:59:24.334567+0000","last_undegraded":"2024-09-16T16:59:24.334567+0000","last_fullsized":"2024-09-16T16:59:24.334567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.741461+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:59:23.741461+0000","last_peered":"2024-09-16T16:59:23.741461+0000","last_clean":"2024-09-16T16:59:23.741461+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:59:23.741461+0000","last_undegraded":"2024-09-16T16:59:23.741461+0000","last_fullsized":"2024-09-16T16:59:23.741461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'640","reported_seq":682,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.578816+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:59:22.578816+0000","last_peered":"2024-09-16T16:59:22.578816+0000","last_clean":"2024-09-16T16:59:22.578816+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:59:22.578816+0000","last_undegraded":"2024-09-16T16:59:22.578816+0000","last_fullsized":"2024-09-16T16:59:22.578816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.274816+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:59:24.274816+0000","last_peered":"2024-09-16T16:59:24.274816+0000","last_clean":"2024-09-16T16:59:24.274816+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:59:24.274816+0000","last_undegraded":"2024-09-16T16:59:24.274816+0000","last_fullsized":"2024-09-16T16:59:24.274816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"72'544","reported_seq":586,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.683475+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:59:22.683475+0000","last_peered":"2024-09-16T16:59:22.683475+0000","last_clean":"2024-09-16T16:59:22.683475+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:59:22.683475+0000","last_undegraded":"2024-09-16T16:59:22.683475+0000","last_fullsized":"2024-09-16T16:59:22.683475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'512","reported_seq":554,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.185924+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:59:24.185924+0000","last_peered":"2024-09-16T16:59:24.185924+0000","last_clean":"2024-09-16T16:59:24.185924+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:59:24.185924+0000","last_undegraded":"2024-09-16T16:59:24.185924+0000","last_fullsized":"2024-09-16T16:59:24.185924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'536","reported_seq":578,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.904937+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:59:23.904937+0000","last_peered":"2024-09-16T16:59:23.904937+0000","last_clean":"2024-09-16T16:59:23.904937+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:59:23.904937+0000","last_undegraded":"2024-09-16T16:59:23.904937+0000","last_fullsized":"2024-09-16T16:59:23.904937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":74227712,"num_objects":1133,"num_object_clones":0,"num_object_copies":3399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9061,"num_write_kb":72488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740818432,"internally_reserved":0,"allocated":470675456,"data_stored":470675456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9061,"ondisk_log_size":9061,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740826624,"internally_reserved":0,"allocated":470667264,"data_stored":470667264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124704,"kb_used_data":124704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173024,"statfs":{"total":53552873472,"available":53425176576,"internally_reserved":0,"allocated":127696896,"data_stored":127696896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96996,"kb_used_data":96996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200732,"statfs":{"total":53552873472,"available":53453549568,"internally_reserved":0,"allocated":99323904,"data_stored":99323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93340,"kb_used_data":93340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204388,"statfs":{"total":53552873472,"available":53457293312,"internally_reserved":0,"allocated":95580160,"data_stored":95580160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":141904,"kb_used_data":141904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52155824,"statfs":{"total":53552873472,"available":53407563776,"internally_reserved":0,"allocated":145309696,"data_stored":145309696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53406994432,"internally_reserved":0,"allocated":145879040,"data_stored":145879040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53406986240,"internally_reserved":0,"allocated":145887232,"data_stored":145887232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:33.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:33.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:33.539+0000 7f8f3db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:33.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:33.549+0000 7f8f3db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:35.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:36.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:36.081+0000 7fd21a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:36.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:36.089+0000 7fd21a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:36.846 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:36.847 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:36.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:37.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:37.014+0000 7f30ff551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:37.024+0000 7f30ff551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:37.304 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:37.305 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2024-09-16T16:59:36.510305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":74818099,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9142,"num_write_kb":73596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9116,"ondisk_log_size":9116,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":456944,"kb_used_data":456944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208733968,"statfs":{"total":214211493888,"available":213743583232,"internally_reserved":0,"allocated":467910656,"data_stored":467910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001491"},"pg_stats":[{"pgid":"9.7","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.839539+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:59:23.839539+0000","last_peered":"2024-09-16T16:59:23.839539+0000","last_clean":"2024-09-16T16:59:23.839539+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:59:23.839539+0000","last_undegraded":"2024-09-16T16:59:23.839539+0000","last_fullsized":"2024-09-16T16:59:23.839539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'624","reported_seq":666,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.140304+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:59:24.140304+0000","last_peered":"2024-09-16T16:59:24.140304+0000","last_clean":"2024-09-16T16:59:24.140304+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:59:24.140304+0000","last_undegraded":"2024-09-16T16:59:24.140304+0000","last_fullsized":"2024-09-16T16:59:24.140304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.075368+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:59:24.075368+0000","last_peered":"2024-09-16T16:59:24.075368+0000","last_clean":"2024-09-16T16:59:24.075368+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:59:24.075368+0000","last_undegraded":"2024-09-16T16:59:24.075368+0000","last_fullsized":"2024-09-16T16:59:24.075368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'616","reported_seq":658,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.039668+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:59:23.039668+0000","last_peered":"2024-09-16T16:59:23.039668+0000","last_clean":"2024-09-16T16:59:23.039668+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:59:23.039668+0000","last_undegraded":"2024-09-16T16:59:23.039668+0000","last_fullsized":"2024-09-16T16:59:23.039668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.116805+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:59:22.116805+0000","last_peered":"2024-09-16T16:59:22.116805+0000","last_clean":"2024-09-16T16:59:22.116805+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:59:22.116805+0000","last_undegraded":"2024-09-16T16:59:22.116805+0000","last_fullsized":"2024-09-16T16:59:22.116805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'533","reported_seq":575,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.393917+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:59:24.393917+0000","last_peered":"2024-09-16T16:59:24.393917+0000","last_clean":"2024-09-16T16:59:24.393917+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:59:24.393917+0000","last_undegraded":"2024-09-16T16:59:24.393917+0000","last_fullsized":"2024-09-16T16:59:24.393917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4366336,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.933990+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:59:22.933990+0000","last_peered":"2024-09-16T16:59:22.933990+0000","last_clean":"2024-09-16T16:59:22.933990+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:59:22.933990+0000","last_undegraded":"2024-09-16T16:59:22.933990+0000","last_fullsized":"2024-09-16T16:59:22.933990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.114783+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:59:23.114783+0000","last_peered":"2024-09-16T16:59:23.114783+0000","last_clean":"2024-09-16T16:59:23.114783+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:59:23.114783+0000","last_undegraded":"2024-09-16T16:59:23.114783+0000","last_fullsized":"2024-09-16T16:59:23.114783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'576","reported_seq":618,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:19.276183+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:59:19.276183+0000","last_peered":"2024-09-16T16:59:19.276183+0000","last_clean":"2024-09-16T16:59:19.276183+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:59:19.276183+0000","last_undegraded":"2024-09-16T16:59:19.276183+0000","last_fullsized":"2024-09-16T16:59:19.276183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.334567+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:59:24.334567+0000","last_peered":"2024-09-16T16:59:24.334567+0000","last_clean":"2024-09-16T16:59:24.334567+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:59:24.334567+0000","last_undegraded":"2024-09-16T16:59:24.334567+0000","last_fullsized":"2024-09-16T16:59:24.334567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.741461+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:59:23.741461+0000","last_peered":"2024-09-16T16:59:23.741461+0000","last_clean":"2024-09-16T16:59:23.741461+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:59:23.741461+0000","last_undegraded":"2024-09-16T16:59:23.741461+0000","last_fullsized":"2024-09-16T16:59:23.741461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'640","reported_seq":682,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.578816+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:59:22.578816+0000","last_peered":"2024-09-16T16:59:22.578816+0000","last_clean":"2024-09-16T16:59:22.578816+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:59:22.578816+0000","last_undegraded":"2024-09-16T16:59:22.578816+0000","last_fullsized":"2024-09-16T16:59:22.578816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.274816+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:59:24.274816+0000","last_peered":"2024-09-16T16:59:24.274816+0000","last_clean":"2024-09-16T16:59:24.274816+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:59:24.274816+0000","last_undegraded":"2024-09-16T16:59:24.274816+0000","last_fullsized":"2024-09-16T16:59:24.274816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"72'544","reported_seq":586,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.683475+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:59:22.683475+0000","last_peered":"2024-09-16T16:59:22.683475+0000","last_clean":"2024-09-16T16:59:22.683475+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:59:22.683475+0000","last_undegraded":"2024-09-16T16:59:22.683475+0000","last_fullsized":"2024-09-16T16:59:22.683475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'512","reported_seq":554,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.185924+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:59:24.185924+0000","last_peered":"2024-09-16T16:59:24.185924+0000","last_clean":"2024-09-16T16:59:24.185924+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:59:24.185924+0000","last_undegraded":"2024-09-16T16:59:24.185924+0000","last_fullsized":"2024-09-16T16:59:24.185924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'536","reported_seq":578,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.904937+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:59:23.904937+0000","last_peered":"2024-09-16T16:59:23.904937+0000","last_clean":"2024-09-16T16:59:23.904937+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:59:23.904937+0000","last_undegraded":"2024-09-16T16:59:23.904937+0000","last_fullsized":"2024-09-16T16:59:23.904937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":74227712,"num_objects":1133,"num_object_clones":0,"num_object_copies":3399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9061,"num_write_kb":72488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740818432,"internally_reserved":0,"allocated":470675456,"data_stored":470675456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9061,"ondisk_log_size":9061,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740826624,"internally_reserved":0,"allocated":470667264,"data_stored":470667264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124704,"kb_used_data":124704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173024,"statfs":{"total":53552873472,"available":53425176576,"internally_reserved":0,"allocated":127696896,"data_stored":127696896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96996,"kb_used_data":96996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200732,"statfs":{"total":53552873472,"available":53453549568,"internally_reserved":0,"allocated":99323904,"data_stored":99323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93340,"kb_used_data":93340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204388,"statfs":{"total":53552873472,"available":53457293312,"internally_reserved":0,"allocated":95580160,"data_stored":95580160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":141904,"kb_used_data":141904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52155824,"statfs":{"total":53552873472,"available":53407563776,"internally_reserved":0,"allocated":145309696,"data_stored":145309696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53406994432,"internally_reserved":0,"allocated":145879040,"data_stored":145879040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53406986240,"internally_reserved":0,"allocated":145887232,"data_stored":145887232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:38.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:38.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:38.477+0000 7fa225d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:38.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:38.485+0000 7fa225d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:38.592 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1135 objects 2024-09-16T16:59:38.592 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :13.0435 2024-09-16T16:59:40.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:40.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:40.738+0000 7f4a64c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:40.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:40.744+0000 7f4a64c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:42.332 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:42.332 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:42.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:42.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:42.455+0000 7fb753151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:42.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:42.464+0000 7fb753151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:42.659 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:42.659 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-09-16T16:59:42.511628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":74818099,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9142,"num_write_kb":73596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9116,"ondisk_log_size":9116,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":456944,"kb_used_data":456944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208733968,"statfs":{"total":214211493888,"available":213743583232,"internally_reserved":0,"allocated":467910656,"data_stored":467910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002460"},"pg_stats":[{"pgid":"9.7","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.839539+0000","last_change":"2024-09-16T16:57:53.620176+0000","last_active":"2024-09-16T16:59:23.839539+0000","last_peered":"2024-09-16T16:59:23.839539+0000","last_clean":"2024-09-16T16:59:23.839539+0000","last_became_active":"2024-09-16T16:57:53.593679+0000","last_became_peered":"2024-09-16T16:57:53.593679+0000","last_unstale":"2024-09-16T16:59:23.839539+0000","last_undegraded":"2024-09-16T16:59:23.839539+0000","last_fullsized":"2024-09-16T16:59:23.839539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"72'624","reported_seq":666,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.140304+0000","last_change":"2024-09-16T16:57:53.511015+0000","last_active":"2024-09-16T16:59:24.140304+0000","last_peered":"2024-09-16T16:59:24.140304+0000","last_clean":"2024-09-16T16:59:24.140304+0000","last_became_active":"2024-09-16T16:57:53.491804+0000","last_became_peered":"2024-09-16T16:57:53.491804+0000","last_unstale":"2024-09-16T16:59:24.140304+0000","last_undegraded":"2024-09-16T16:59:24.140304+0000","last_fullsized":"2024-09-16T16:59:24.140304+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.075368+0000","last_change":"2024-09-16T16:57:53.588734+0000","last_active":"2024-09-16T16:59:24.075368+0000","last_peered":"2024-09-16T16:59:24.075368+0000","last_clean":"2024-09-16T16:59:24.075368+0000","last_became_active":"2024-09-16T16:57:53.569775+0000","last_became_peered":"2024-09-16T16:57:53.569775+0000","last_unstale":"2024-09-16T16:59:24.075368+0000","last_undegraded":"2024-09-16T16:59:24.075368+0000","last_fullsized":"2024-09-16T16:59:24.075368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"72'616","reported_seq":658,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.039668+0000","last_change":"2024-09-16T16:57:53.674518+0000","last_active":"2024-09-16T16:59:23.039668+0000","last_peered":"2024-09-16T16:59:23.039668+0000","last_clean":"2024-09-16T16:59:23.039668+0000","last_became_active":"2024-09-16T16:57:53.657987+0000","last_became_peered":"2024-09-16T16:57:53.657987+0000","last_unstale":"2024-09-16T16:59:23.039668+0000","last_undegraded":"2024-09-16T16:59:23.039668+0000","last_fullsized":"2024-09-16T16:59:23.039668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.116805+0000","last_change":"2024-09-16T16:57:53.767142+0000","last_active":"2024-09-16T16:59:22.116805+0000","last_peered":"2024-09-16T16:59:22.116805+0000","last_clean":"2024-09-16T16:59:22.116805+0000","last_became_active":"2024-09-16T16:57:53.761241+0000","last_became_peered":"2024-09-16T16:57:53.761241+0000","last_unstale":"2024-09-16T16:59:22.116805+0000","last_undegraded":"2024-09-16T16:59:22.116805+0000","last_fullsized":"2024-09-16T16:59:22.116805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"72'533","reported_seq":575,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.393917+0000","last_change":"2024-09-16T16:57:53.663455+0000","last_active":"2024-09-16T16:59:24.393917+0000","last_peered":"2024-09-16T16:59:24.393917+0000","last_clean":"2024-09-16T16:59:24.393917+0000","last_became_active":"2024-09-16T16:57:53.644872+0000","last_became_peered":"2024-09-16T16:57:53.644872+0000","last_unstale":"2024-09-16T16:59:24.393917+0000","last_undegraded":"2024-09-16T16:59:24.393917+0000","last_fullsized":"2024-09-16T16:59:24.393917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4366336,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.933990+0000","last_change":"2024-09-16T16:57:53.630787+0000","last_active":"2024-09-16T16:59:22.933990+0000","last_peered":"2024-09-16T16:59:22.933990+0000","last_clean":"2024-09-16T16:59:22.933990+0000","last_became_active":"2024-09-16T16:57:53.604380+0000","last_became_peered":"2024-09-16T16:57:53.604380+0000","last_unstale":"2024-09-16T16:59:22.933990+0000","last_undegraded":"2024-09-16T16:59:22.933990+0000","last_fullsized":"2024-09-16T16:59:22.933990+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"72'528","reported_seq":570,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.114783+0000","last_change":"2024-09-16T16:57:53.619341+0000","last_active":"2024-09-16T16:59:23.114783+0000","last_peered":"2024-09-16T16:59:23.114783+0000","last_clean":"2024-09-16T16:59:23.114783+0000","last_became_active":"2024-09-16T16:57:53.602118+0000","last_became_peered":"2024-09-16T16:57:53.602118+0000","last_unstale":"2024-09-16T16:59:23.114783+0000","last_undegraded":"2024-09-16T16:59:23.114783+0000","last_fullsized":"2024-09-16T16:59:23.114783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"72'576","reported_seq":618,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:19.276183+0000","last_change":"2024-09-16T16:57:53.544479+0000","last_active":"2024-09-16T16:59:19.276183+0000","last_peered":"2024-09-16T16:59:19.276183+0000","last_clean":"2024-09-16T16:59:19.276183+0000","last_became_active":"2024-09-16T16:57:53.534744+0000","last_became_peered":"2024-09-16T16:57:53.534744+0000","last_unstale":"2024-09-16T16:59:19.276183+0000","last_undegraded":"2024-09-16T16:59:19.276183+0000","last_fullsized":"2024-09-16T16:59:19.276183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"72'520","reported_seq":562,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.334567+0000","last_change":"2024-09-16T16:57:53.578424+0000","last_active":"2024-09-16T16:59:24.334567+0000","last_peered":"2024-09-16T16:59:24.334567+0000","last_clean":"2024-09-16T16:59:24.334567+0000","last_became_active":"2024-09-16T16:57:53.559234+0000","last_became_peered":"2024-09-16T16:57:53.559234+0000","last_unstale":"2024-09-16T16:59:24.334567+0000","last_undegraded":"2024-09-16T16:59:24.334567+0000","last_fullsized":"2024-09-16T16:59:24.334567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"72'608","reported_seq":650,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.741461+0000","last_change":"2024-09-16T16:57:53.693433+0000","last_active":"2024-09-16T16:59:23.741461+0000","last_peered":"2024-09-16T16:59:23.741461+0000","last_clean":"2024-09-16T16:59:23.741461+0000","last_became_active":"2024-09-16T16:57:53.683925+0000","last_became_peered":"2024-09-16T16:57:53.683925+0000","last_unstale":"2024-09-16T16:59:23.741461+0000","last_undegraded":"2024-09-16T16:59:23.741461+0000","last_fullsized":"2024-09-16T16:59:23.741461+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"72'640","reported_seq":682,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.578816+0000","last_change":"2024-09-16T16:57:53.725325+0000","last_active":"2024-09-16T16:59:22.578816+0000","last_peered":"2024-09-16T16:59:22.578816+0000","last_clean":"2024-09-16T16:59:22.578816+0000","last_became_active":"2024-09-16T16:57:53.719350+0000","last_became_peered":"2024-09-16T16:57:53.719350+0000","last_unstale":"2024-09-16T16:59:22.578816+0000","last_undegraded":"2024-09-16T16:59:22.578816+0000","last_fullsized":"2024-09-16T16:59:22.578816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"72'584","reported_seq":626,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.274816+0000","last_change":"2024-09-16T16:57:53.635711+0000","last_active":"2024-09-16T16:59:24.274816+0000","last_peered":"2024-09-16T16:59:24.274816+0000","last_clean":"2024-09-16T16:59:24.274816+0000","last_became_active":"2024-09-16T16:57:53.602898+0000","last_became_peered":"2024-09-16T16:57:53.602898+0000","last_unstale":"2024-09-16T16:59:24.274816+0000","last_undegraded":"2024-09-16T16:59:24.274816+0000","last_fullsized":"2024-09-16T16:59:24.274816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"72'544","reported_seq":586,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:22.683475+0000","last_change":"2024-09-16T16:57:53.570838+0000","last_active":"2024-09-16T16:59:22.683475+0000","last_peered":"2024-09-16T16:59:22.683475+0000","last_clean":"2024-09-16T16:59:22.683475+0000","last_became_active":"2024-09-16T16:57:53.553123+0000","last_became_peered":"2024-09-16T16:57:53.553123+0000","last_unstale":"2024-09-16T16:59:22.683475+0000","last_undegraded":"2024-09-16T16:59:22.683475+0000","last_fullsized":"2024-09-16T16:59:22.683475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"72'512","reported_seq":554,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:24.185924+0000","last_change":"2024-09-16T16:57:53.793343+0000","last_active":"2024-09-16T16:59:24.185924+0000","last_peered":"2024-09-16T16:59:24.185924+0000","last_clean":"2024-09-16T16:59:24.185924+0000","last_became_active":"2024-09-16T16:57:53.787307+0000","last_became_peered":"2024-09-16T16:57:53.787307+0000","last_unstale":"2024-09-16T16:59:24.185924+0000","last_undegraded":"2024-09-16T16:59:24.185924+0000","last_fullsized":"2024-09-16T16:59:24.185924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"72'536","reported_seq":578,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:59:23.904937+0000","last_change":"2024-09-16T16:57:53.549452+0000","last_active":"2024-09-16T16:59:23.904937+0000","last_peered":"2024-09-16T16:59:23.904937+0000","last_clean":"2024-09-16T16:59:23.904937+0000","last_became_active":"2024-09-16T16:57:53.533777+0000","last_became_peered":"2024-09-16T16:57:53.533777+0000","last_unstale":"2024-09-16T16:59:23.904937+0000","last_undegraded":"2024-09-16T16:59:23.904937+0000","last_fullsized":"2024-09-16T16:59:23.904937+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:57:52.358430+0000","last_clean_scrub_stamp":"2024-09-16T16:57:52.358430+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":74227712,"num_objects":1133,"num_object_clones":0,"num_object_copies":3399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9061,"num_write_kb":72488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740818432,"internally_reserved":0,"allocated":470675456,"data_stored":470675456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9061,"ondisk_log_size":9061,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740826624,"internally_reserved":0,"allocated":470667264,"data_stored":470667264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124704,"kb_used_data":124704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173024,"statfs":{"total":53552873472,"available":53425176576,"internally_reserved":0,"allocated":127696896,"data_stored":127696896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96996,"kb_used_data":96996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200732,"statfs":{"total":53552873472,"available":53453549568,"internally_reserved":0,"allocated":99323904,"data_stored":99323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93340,"kb_used_data":93340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204388,"statfs":{"total":53552873472,"available":53457293312,"internally_reserved":0,"allocated":95580160,"data_stored":95580160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":141904,"kb_used_data":141904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52155824,"statfs":{"total":53552873472,"available":53407563776,"internally_reserved":0,"allocated":145309696,"data_stored":145309696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53406994432,"internally_reserved":0,"allocated":145879040,"data_stored":145879040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":53552873472,"available":53406986240,"internally_reserved":0,"allocated":145887232,"data_stored":145887232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:42.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:42.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:42.962+0000 7f15e6a5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:42.968+0000 7f15e6a5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:44.257 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_6 2024-09-16T16:59:44.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2024-09-16T16:59:44.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:44.380+0000 7f9063391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:44.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:44.394+0000 7f9063391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:45.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:45.190+0000 7ff843791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:45.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:45.196+0000 7ff843791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:45.210 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_6' removed 2024-09-16T16:59:45.228 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T16:59:45.229 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T16:59:45.229 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_7 2024-09-16T16:59:45.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_7 16 2024-09-16T16:59:45.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:45.387+0000 7fe520151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:45.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:45.404+0000 7fe520151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_7' created 2024-09-16T16:59:46.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2024-09-16T16:59:46.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:46.386+0000 7f0e72f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:46.402+0000 7f0e72f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:47.219 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rados' on pool 'unique_pool_7' 2024-09-16T16:59:47.511 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:47.632+0000 7f36e40bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:47.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:47.638+0000 7f36e40bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:47.674 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:47.674 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:47.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:47.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:47.784+0000 7f05c385a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:47.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:47.793+0000 7f05c385a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:47.989 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:47.989 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:48.002 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-09-16T16:59:47.219670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":456944,"kb_used_data":456944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208733968,"statfs":{"total":214211493888,"available":213743583232,"internally_reserved":0,"allocated":467910656,"data_stored":467910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-74227712,"num_objects":-1133,"num_object_clones":0,"num_object_copies":-3399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-9061,"num_write_kb":-72488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.708489"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740826624,"internally_reserved":0,"allocated":470667264,"data_stored":470667264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124704,"kb_used_data":124704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173024,"statfs":{"total":53552873472,"available":53425176576,"internally_reserved":0,"allocated":127696896,"data_stored":127696896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96996,"kb_used_data":96996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200732,"statfs":{"total":53552873472,"available":53453549568,"internally_reserved":0,"allocated":99323904,"data_stored":99323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93340,"kb_used_data":93340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204388,"statfs":{"total":53552873472,"available":53457293312,"internally_reserved":0,"allocated":95580160,"data_stored":95580160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":141904,"kb_used_data":141904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52155824,"statfs":{"total":53552873472,"available":53407563776,"internally_reserved":0,"allocated":145309696,"data_stored":145309696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53406994432,"internally_reserved":0,"allocated":145879040,"data_stored":145879040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:48.241 DEBUG:teuthology.orchestra.run.smithi002:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_7 bench 90 write' 2024-09-16T16:59:48.243 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T16:59:48.244 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T16:59:48.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:hints = 1 2024-09-16T16:59:48.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T16:59:48.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object prefix: benchmark_data_smithi002_60615 2024-09-16T16:59:48.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T16:59:48.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 0 0 0 0 0 0 - 0 2024-09-16T16:59:49.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 1 16 113 97 0.757762 0.757812 0.139505 0.151679 2024-09-16T16:59:49.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:49.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:49.861+0000 7f2063e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:49.870+0000 7f2063e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:50.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 2 16 231 215 0.839771 0.921875 0.0831422 0.143242 2024-09-16T16:59:51.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 3 16 336 320 0.833258 0.820312 0.133269 0.144527 2024-09-16T16:59:52.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:52.197+0000 7f03232d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:52.205+0000 7f03232d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:52.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 4 16 429 413 0.806568 0.726562 0.144862 0.14934 2024-09-16T16:59:53.004 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:53.004 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:53.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T16:59:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:53.123+0000 7ffadf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:53.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:53.134+0000 7ffadf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:53.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 5 16 531 515 0.804612 0.796875 0.0895701 0.153789 2024-09-16T16:59:53.453 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T16:59:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T16:59:53.478 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2024-09-16T16:59:52.513609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":456944,"kb_used_data":456944,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208733968,"statfs":{"total":214211493888,"available":213743583232,"internally_reserved":0,"allocated":467910656,"data_stored":467910656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.296898"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":256,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.172120+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:58:52.172120+0000","last_peered":"2024-09-16T16:58:52.172120+0000","last_clean":"2024-09-16T16:58:52.172120+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:58:52.172120+0000","last_undegraded":"2024-09-16T16:58:52.172120+0000","last_fullsized":"2024-09-16T16:58:52.172120+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.180852+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:58:52.180852+0000","last_peered":"2024-09-16T16:58:52.180852+0000","last_clean":"2024-09-16T16:58:52.180852+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:58:52.180852+0000","last_undegraded":"2024-09-16T16:58:52.180852+0000","last_fullsized":"2024-09-16T16:58:52.180852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.251459+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:58:52.251459+0000","last_peered":"2024-09-16T16:58:52.251459+0000","last_clean":"2024-09-16T16:58:52.251459+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:58:52.251459+0000","last_undegraded":"2024-09-16T16:58:52.251459+0000","last_fullsized":"2024-09-16T16:58:52.251459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.169045+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:58:52.169045+0000","last_peered":"2024-09-16T16:58:52.169045+0000","last_clean":"2024-09-16T16:58:52.169045+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:58:52.169045+0000","last_undegraded":"2024-09-16T16:58:52.169045+0000","last_fullsized":"2024-09-16T16:58:52.169045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":183,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.239901+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:58:52.239901+0000","last_peered":"2024-09-16T16:58:52.239901+0000","last_clean":"2024-09-16T16:58:52.239901+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:58:52.239901+0000","last_undegraded":"2024-09-16T16:58:52.239901+0000","last_fullsized":"2024-09-16T16:58:52.239901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.165920+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:58:52.165920+0000","last_peered":"2024-09-16T16:58:52.165920+0000","last_clean":"2024-09-16T16:58:52.165920+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:58:52.165920+0000","last_undegraded":"2024-09-16T16:58:52.165920+0000","last_fullsized":"2024-09-16T16:58:52.165920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.176719+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:58:52.176719+0000","last_peered":"2024-09-16T16:58:52.176719+0000","last_clean":"2024-09-16T16:58:52.176719+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:58:52.176719+0000","last_undegraded":"2024-09-16T16:58:52.176719+0000","last_fullsized":"2024-09-16T16:58:52.176719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.168104+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:58:52.168104+0000","last_peered":"2024-09-16T16:58:52.168104+0000","last_clean":"2024-09-16T16:58:52.168104+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:58:52.168104+0000","last_undegraded":"2024-09-16T16:58:52.168104+0000","last_fullsized":"2024-09-16T16:58:52.168104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T16:59:46.211527+0000","last_change":"2024-09-16T16:59:46.211527+0000","last_active":"2024-09-16T16:59:46.211527+0000","last_peered":"2024-09-16T16:59:46.211527+0000","last_clean":"2024-09-16T16:59:46.211527+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T16:59:46.211527+0000","last_undegraded":"2024-09-16T16:59:46.211527+0000","last_fullsized":"2024-09-16T16:59:46.211527+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T16:58:52.177975+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:58:52.177975+0000","last_peered":"2024-09-16T16:58:52.177975+0000","last_clean":"2024-09-16T16:58:52.177975+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:58:52.177975+0000","last_undegraded":"2024-09-16T16:58:52.177975+0000","last_fullsized":"2024-09-16T16:58:52.177975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213740826624,"internally_reserved":0,"allocated":470667264,"data_stored":470667264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":124704,"kb_used_data":124704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52173024,"statfs":{"total":53552873472,"available":53425176576,"internally_reserved":0,"allocated":127696896,"data_stored":127696896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":96996,"kb_used_data":96996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200732,"statfs":{"total":53552873472,"available":53453549568,"internally_reserved":0,"allocated":99323904,"data_stored":99323904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":93340,"kb_used_data":93340,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52204388,"statfs":{"total":53552873472,"available":53457293312,"internally_reserved":0,"allocated":95580160,"data_stored":95580160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":141904,"kb_used_data":141904,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52155824,"statfs":{"total":53552873472,"available":53407563776,"internally_reserved":0,"allocated":145309696,"data_stored":145309696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53406994432,"internally_reserved":0,"allocated":145879040,"data_stored":145879040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53456760832,"internally_reserved":0,"allocated":96112640,"data_stored":96112640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53453066240,"internally_reserved":0,"allocated":99807232,"data_stored":99807232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53424005120,"internally_reserved":0,"allocated":128868352,"data_stored":128868352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T16:59:54.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 6 16 615 599 0.779874 0.65625 0.325882 0.156267 2024-09-16T16:59:54.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:54.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:54.526+0000 7f6020151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:54.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:54.539+0000 7f6020151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:55.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 7 16 713 697 0.777827 0.765625 0.305436 0.156362 2024-09-16T16:59:56.311 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 8 16 797 781 0.762623 0.65625 0.285819 0.159907 2024-09-16T16:59:56.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T16:59:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:56.921+0000 7fcab22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:56.929+0000 7fcab22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:57.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 9 16 904 888 0.77076 0.835938 0.0783649 0.160484 2024-09-16T16:59:58.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 10 16 1007 991 0.774146 0.804688 0.20303 0.159919 2024-09-16T16:59:58.479 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T16:59:58.480 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T16:59:58.480 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T16:59:58.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T16:59:58.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:58.615+0000 7fb85d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:58.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:58.632+0000 7fb85d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:58.747 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:58.752 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:58.753 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:58.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T16:59:58.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:58.934+0000 7f3628991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:58.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:58.948+0000 7f3628991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:58.969 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:58.972 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:58.972 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:58.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T16:59:59.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:59.109+0000 7f8eaa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:59.123+0000 7f8eaa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:59.146 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:59.147 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:59.151 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:59.152 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T16:59:59.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T16:59:59.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T16:59:59.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:59.294+0000 7fa4ab591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:59.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 11 16 1117 1101 0.781887 0.859375 0.137606 0.158952 2024-09-16T16:59:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:59.314+0000 7fa4ab591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:59.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:59.338+0000 7f6b41b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T16:59:59.347 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T16:59:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T16:59:59.348 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T16:59:59.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T16:59:59.349+0000 7f6b408ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T16:59:59.353 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T16:59:59.353 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:00.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 12 16 1242 1226 0.798101 0.976562 0.0942091 0.155968 2024-09-16T17:00:01.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 13 16 1364 1348 0.810019 0.953125 0.186962 0.153453 2024-09-16T17:00:01.625 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:01.778+0000 7f55ac191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:01.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:01.789+0000 7f55ac191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:02.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 14 16 1481 1465 0.817444 0.914062 0.15368 0.152204 2024-09-16T17:00:03.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 15 16 1590 1574 0.819712 0.851562 0.133566 0.151823 2024-09-16T17:00:04.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.258+0000 7f0d96791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.268+0000 7f0d96791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 16 16 1691 1675 0.817792 0.789062 0.0878048 0.152333 2024-09-16T17:00:04.354 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:04.354 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:04.354 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:00:04.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:00:04.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.481+0000 7f312ed48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.495+0000 7f312ed48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.651 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:04.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:04.656 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:04.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:00:04.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.777+0000 7fd24fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.793+0000 7fd24fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.817 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:04.817 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:04.818 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:04.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:04.822 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:04.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:00:04.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.963+0000 7fd4c84d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:04.976+0000 7fd4c84d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:04.997 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:04.998 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:05.002 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:05.002 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:05.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:00:05.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:05.128+0000 7fce6e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:05.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:05.140+0000 7fce6e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:05.164 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:05.166 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:05.167 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:05.312 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 17 16 1773 1757 0.807367 0.640625 0.291447 0.153912 2024-09-16T17:00:06.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 18 16 1874 1858 0.806346 0.789062 0.208789 0.153659 2024-09-16T17:00:06.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:06.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:06.705+0000 7feccd69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:06.712+0000 7feccd69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:07.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 19 16 1971 1955 0.803788 0.757812 0.0694098 0.154354 2024-09-16T17:00:08.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T17:00:08.313100+0000 min lat: 0.0228199 max lat: 0.63898 avg lat: 0.1563 2024-09-16T17:00:08.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T17:00:08.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 20 16 2046 2030 0.792892 0.585938 0.439765 0.1563 2024-09-16T17:00:08.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:09.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:09.073+0000 7f747f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:09.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:09.084+0000 7f747f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:09.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 21 16 2133 2117 0.787498 0.679688 0.104781 0.15818 2024-09-16T17:00:10.168 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:10.168 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:10.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:10.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 22 16 2204 2188 0.776913 0.554688 0.0852722 0.160264 2024-09-16T17:00:10.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:10.310+0000 7f476db51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:10.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:10.324+0000 7f476db51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:10.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:00:10.702 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:00:10.717 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":469,"stamp":"2024-09-16T17:00:10.517018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5694003,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":704,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":678,"ondisk_log_size":678,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":39660,"kb_used_data":39660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209151252,"statfs":{"total":214211493888,"available":214170882048,"internally_reserved":0,"allocated":40611840,"data_stored":40611840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002201"},"pg_stats":[{"pgid":"10.7","version":"80'72","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:52.742133+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T16:59:52.742133+0000","last_peered":"2024-09-16T16:59:52.742133+0000","last_clean":"2024-09-16T16:59:52.742133+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T16:59:52.742133+0000","last_undegraded":"2024-09-16T16:59:52.742133+0000","last_fullsized":"2024-09-16T16:59:52.742133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"80'48","reported_seq":60,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:54.320565+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T16:59:54.320565+0000","last_peered":"2024-09-16T16:59:54.320565+0000","last_clean":"2024-09-16T16:59:54.320565+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T16:59:54.320565+0000","last_undegraded":"2024-09-16T16:59:54.320565+0000","last_fullsized":"2024-09-16T16:59:54.320565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:51.578117+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T16:59:51.578117+0000","last_peered":"2024-09-16T16:59:51.578117+0000","last_clean":"2024-09-16T16:59:51.578117+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T16:59:51.578117+0000","last_undegraded":"2024-09-16T16:59:51.578117+0000","last_fullsized":"2024-09-16T16:59:51.578117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"80'40","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:54.193906+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T16:59:54.193906+0000","last_peered":"2024-09-16T16:59:54.193906+0000","last_clean":"2024-09-16T16:59:54.193906+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T16:59:54.193906+0000","last_undegraded":"2024-09-16T16:59:54.193906+0000","last_fullsized":"2024-09-16T16:59:54.193906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"80'24","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.531770+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T16:59:53.531770+0000","last_peered":"2024-09-16T16:59:53.531770+0000","last_clean":"2024-09-16T16:59:53.531770+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T16:59:53.531770+0000","last_undegraded":"2024-09-16T16:59:53.531770+0000","last_fullsized":"2024-09-16T16:59:53.531770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"80'56","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.726413+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T16:59:53.726413+0000","last_peered":"2024-09-16T16:59:53.726413+0000","last_clean":"2024-09-16T16:59:53.726413+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T16:59:53.726413+0000","last_undegraded":"2024-09-16T16:59:53.726413+0000","last_fullsized":"2024-09-16T16:59:53.726413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"80'24","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.380262+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T16:59:53.380262+0000","last_peered":"2024-09-16T16:59:53.380262+0000","last_clean":"2024-09-16T16:59:53.380262+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T16:59:53.380262+0000","last_undegraded":"2024-09-16T16:59:53.380262+0000","last_fullsized":"2024-09-16T16:59:53.380262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"80'31","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:54.385379+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T16:59:54.385379+0000","last_peered":"2024-09-16T16:59:54.385379+0000","last_clean":"2024-09-16T16:59:54.385379+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T16:59:54.385379+0000","last_undegraded":"2024-09-16T16:59:54.385379+0000","last_fullsized":"2024-09-16T16:59:54.385379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253952,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"80'80","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.809438+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T16:59:53.809438+0000","last_peered":"2024-09-16T16:59:53.809438+0000","last_clean":"2024-09-16T16:59:53.809438+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T16:59:53.809438+0000","last_undegraded":"2024-09-16T16:59:53.809438+0000","last_fullsized":"2024-09-16T16:59:53.809438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240375+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:59:48.240375+0000","last_peered":"2024-09-16T16:59:48.240375+0000","last_clean":"2024-09-16T16:59:48.240375+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:59:48.240375+0000","last_undegraded":"2024-09-16T16:59:48.240375+0000","last_fullsized":"2024-09-16T16:59:48.240375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.248414+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:59:48.248414+0000","last_peered":"2024-09-16T16:59:48.248414+0000","last_clean":"2024-09-16T16:59:48.248414+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:59:48.248414+0000","last_undegraded":"2024-09-16T16:59:48.248414+0000","last_fullsized":"2024-09-16T16:59:48.248414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"80'40","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.260342+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T16:59:53.260342+0000","last_peered":"2024-09-16T16:59:53.260342+0000","last_clean":"2024-09-16T16:59:53.260342+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T16:59:53.260342+0000","last_undegraded":"2024-09-16T16:59:53.260342+0000","last_fullsized":"2024-09-16T16:59:53.260342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250640+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:59:48.250640+0000","last_peered":"2024-09-16T16:59:48.250640+0000","last_clean":"2024-09-16T16:59:48.250640+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:59:48.250640+0000","last_undegraded":"2024-09-16T16:59:48.250640+0000","last_fullsized":"2024-09-16T16:59:48.250640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"80'16","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:52.916680+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T16:59:52.916680+0000","last_peered":"2024-09-16T16:59:52.916680+0000","last_clean":"2024-09-16T16:59:52.916680+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T16:59:52.916680+0000","last_undegraded":"2024-09-16T16:59:52.916680+0000","last_fullsized":"2024-09-16T16:59:52.916680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.239538+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:59:48.239538+0000","last_peered":"2024-09-16T16:59:48.239538+0000","last_clean":"2024-09-16T16:59:48.239538+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:59:48.239538+0000","last_undegraded":"2024-09-16T16:59:48.239538+0000","last_fullsized":"2024-09-16T16:59:48.239538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"80'16","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.432991+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T16:59:53.432991+0000","last_peered":"2024-09-16T16:59:53.432991+0000","last_clean":"2024-09-16T16:59:53.432991+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T16:59:53.432991+0000","last_undegraded":"2024-09-16T16:59:53.432991+0000","last_fullsized":"2024-09-16T16:59:53.432991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240192+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:59:48.240192+0000","last_peered":"2024-09-16T16:59:48.240192+0000","last_clean":"2024-09-16T16:59:48.240192+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:59:48.240192+0000","last_undegraded":"2024-09-16T16:59:48.240192+0000","last_fullsized":"2024-09-16T16:59:48.240192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"80'48","reported_seq":60,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.302582+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T16:59:53.302582+0000","last_peered":"2024-09-16T16:59:53.302582+0000","last_clean":"2024-09-16T16:59:53.302582+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T16:59:53.302582+0000","last_undegraded":"2024-09-16T16:59:53.302582+0000","last_fullsized":"2024-09-16T16:59:53.302582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250969+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:59:48.250969+0000","last_peered":"2024-09-16T16:59:48.250969+0000","last_clean":"2024-09-16T16:59:48.250969+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:59:48.250969+0000","last_undegraded":"2024-09-16T16:59:48.250969+0000","last_fullsized":"2024-09-16T16:59:48.250969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.858941+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T16:59:53.858941+0000","last_peered":"2024-09-16T16:59:53.858941+0000","last_clean":"2024-09-16T16:59:53.858941+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T16:59:53.858941+0000","last_undegraded":"2024-09-16T16:59:53.858941+0000","last_fullsized":"2024-09-16T16:59:53.858941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.245594+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:59:48.245594+0000","last_peered":"2024-09-16T16:59:48.245594+0000","last_clean":"2024-09-16T16:59:48.245594+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:59:48.245594+0000","last_undegraded":"2024-09-16T16:59:48.245594+0000","last_fullsized":"2024-09-16T16:59:48.245594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:52.228339+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T16:59:52.228339+0000","last_peered":"2024-09-16T16:59:52.228339+0000","last_clean":"2024-09-16T16:59:52.228339+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T16:59:52.228339+0000","last_undegraded":"2024-09-16T16:59:52.228339+0000","last_fullsized":"2024-09-16T16:59:52.228339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.247773+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:59:48.247773+0000","last_peered":"2024-09-16T16:59:48.247773+0000","last_clean":"2024-09-16T16:59:48.247773+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:59:48.247773+0000","last_undegraded":"2024-09-16T16:59:48.247773+0000","last_fullsized":"2024-09-16T16:59:48.247773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.674778+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T16:59:53.674778+0000","last_peered":"2024-09-16T16:59:53.674778+0000","last_clean":"2024-09-16T16:59:53.674778+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T16:59:53.674778+0000","last_undegraded":"2024-09-16T16:59:53.674778+0000","last_fullsized":"2024-09-16T16:59:53.674778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.244626+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:59:48.244626+0000","last_peered":"2024-09-16T16:59:48.244626+0000","last_clean":"2024-09-16T16:59:48.244626+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:59:48.244626+0000","last_undegraded":"2024-09-16T16:59:48.244626+0000","last_fullsized":"2024-09-16T16:59:48.244626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":5103616,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214169235456,"internally_reserved":0,"allocated":42258432,"data_stored":42258432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":623,"ondisk_log_size":623,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214169251840,"internally_reserved":0,"allocated":42242048,"data_stored":42242048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8772,"kb_used_data":8772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288956,"statfs":{"total":53552873472,"available":53543890944,"internally_reserved":0,"allocated":8982528,"data_stored":8982528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":11924,"kb_used_data":11924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52285804,"statfs":{"total":53552873472,"available":53540663296,"internally_reserved":0,"allocated":12210176,"data_stored":12210176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8432,"kb_used_data":8432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289296,"statfs":{"total":53552873472,"available":53544239104,"internally_reserved":0,"allocated":8634368,"data_stored":8634368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":10532,"kb_used_data":10532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52287196,"statfs":{"total":53552873472,"available":53542088704,"internally_reserved":0,"allocated":10784768,"data_stored":10784768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53541957632,"internally_reserved":0,"allocated":10915840,"data_stored":10915840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543514112,"internally_reserved":0,"allocated":9359360,"data_stored":9359360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53540298752,"internally_reserved":0,"allocated":12574720,"data_stored":12574720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53541957632,"internally_reserved":0,"allocated":10915840,"data_stored":10915840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53543497728,"internally_reserved":0,"allocated":9375744,"data_stored":9375744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53540298752,"internally_reserved":0,"allocated":12574720,"data_stored":12574720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:11.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 23 16 2306 2290 0.777778 0.796875 0.227822 0.16002 2024-09-16T17:00:11.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:11.543+0000 7f8b44351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:11.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:11.550+0000 7f8b44351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:12.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 24 16 2388 2372 0.77206 0.640625 0.096436 0.161104 2024-09-16T17:00:13.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 25 16 2492 2476 0.773675 0.8125 0.263205 0.160897 2024-09-16T17:00:13.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:13.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:13.942+0000 7f3851d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:13.951+0000 7f3851d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:14.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 26 16 2589 2573 0.773061 0.757812 0.126953 0.161076 2024-09-16T17:00:15.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 27 16 2694 2678 0.774809 0.820312 0.270182 0.160653 2024-09-16T17:00:15.720 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:15.720 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:15.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:15.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:15.888+0000 7fb5bcefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:15.900+0000 7fb5bcefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:16.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:16.153 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:00:16.153 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:00:16.176 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":471,"stamp":"2024-09-16T17:00:14.517714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5694003,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":704,"num_write_kb":6092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":678,"ondisk_log_size":678,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":39660,"kb_used_data":39660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209151252,"statfs":{"total":214211493888,"available":214170882048,"internally_reserved":0,"allocated":40611840,"data_stored":40611840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002148"},"pg_stats":[{"pgid":"10.7","version":"80'72","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:52.742133+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T16:59:52.742133+0000","last_peered":"2024-09-16T16:59:52.742133+0000","last_clean":"2024-09-16T16:59:52.742133+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T16:59:52.742133+0000","last_undegraded":"2024-09-16T16:59:52.742133+0000","last_fullsized":"2024-09-16T16:59:52.742133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"80'48","reported_seq":60,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:54.320565+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T16:59:54.320565+0000","last_peered":"2024-09-16T16:59:54.320565+0000","last_clean":"2024-09-16T16:59:54.320565+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T16:59:54.320565+0000","last_undegraded":"2024-09-16T16:59:54.320565+0000","last_fullsized":"2024-09-16T16:59:54.320565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:51.578117+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T16:59:51.578117+0000","last_peered":"2024-09-16T16:59:51.578117+0000","last_clean":"2024-09-16T16:59:51.578117+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T16:59:51.578117+0000","last_undegraded":"2024-09-16T16:59:51.578117+0000","last_fullsized":"2024-09-16T16:59:51.578117+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"80'40","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:54.193906+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T16:59:54.193906+0000","last_peered":"2024-09-16T16:59:54.193906+0000","last_clean":"2024-09-16T16:59:54.193906+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T16:59:54.193906+0000","last_undegraded":"2024-09-16T16:59:54.193906+0000","last_fullsized":"2024-09-16T16:59:54.193906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"80'24","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.531770+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T16:59:53.531770+0000","last_peered":"2024-09-16T16:59:53.531770+0000","last_clean":"2024-09-16T16:59:53.531770+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T16:59:53.531770+0000","last_undegraded":"2024-09-16T16:59:53.531770+0000","last_fullsized":"2024-09-16T16:59:53.531770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"80'56","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.726413+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T16:59:53.726413+0000","last_peered":"2024-09-16T16:59:53.726413+0000","last_clean":"2024-09-16T16:59:53.726413+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T16:59:53.726413+0000","last_undegraded":"2024-09-16T16:59:53.726413+0000","last_fullsized":"2024-09-16T16:59:53.726413+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"80'24","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.380262+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T16:59:53.380262+0000","last_peered":"2024-09-16T16:59:53.380262+0000","last_clean":"2024-09-16T16:59:53.380262+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T16:59:53.380262+0000","last_undegraded":"2024-09-16T16:59:53.380262+0000","last_fullsized":"2024-09-16T16:59:53.380262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"80'31","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:54.385379+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T16:59:54.385379+0000","last_peered":"2024-09-16T16:59:54.385379+0000","last_clean":"2024-09-16T16:59:54.385379+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T16:59:54.385379+0000","last_undegraded":"2024-09-16T16:59:54.385379+0000","last_fullsized":"2024-09-16T16:59:54.385379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":253952,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"80'80","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.809438+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T16:59:53.809438+0000","last_peered":"2024-09-16T16:59:53.809438+0000","last_clean":"2024-09-16T16:59:53.809438+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T16:59:53.809438+0000","last_undegraded":"2024-09-16T16:59:53.809438+0000","last_fullsized":"2024-09-16T16:59:53.809438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240375+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:59:48.240375+0000","last_peered":"2024-09-16T16:59:48.240375+0000","last_clean":"2024-09-16T16:59:48.240375+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:59:48.240375+0000","last_undegraded":"2024-09-16T16:59:48.240375+0000","last_fullsized":"2024-09-16T16:59:48.240375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.248414+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:59:48.248414+0000","last_peered":"2024-09-16T16:59:48.248414+0000","last_clean":"2024-09-16T16:59:48.248414+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:59:48.248414+0000","last_undegraded":"2024-09-16T16:59:48.248414+0000","last_fullsized":"2024-09-16T16:59:48.248414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"80'40","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.260342+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T16:59:53.260342+0000","last_peered":"2024-09-16T16:59:53.260342+0000","last_clean":"2024-09-16T16:59:53.260342+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T16:59:53.260342+0000","last_undegraded":"2024-09-16T16:59:53.260342+0000","last_fullsized":"2024-09-16T16:59:53.260342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250640+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:59:48.250640+0000","last_peered":"2024-09-16T16:59:48.250640+0000","last_clean":"2024-09-16T16:59:48.250640+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:59:48.250640+0000","last_undegraded":"2024-09-16T16:59:48.250640+0000","last_fullsized":"2024-09-16T16:59:48.250640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"80'16","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:52.916680+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T16:59:52.916680+0000","last_peered":"2024-09-16T16:59:52.916680+0000","last_clean":"2024-09-16T16:59:52.916680+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T16:59:52.916680+0000","last_undegraded":"2024-09-16T16:59:52.916680+0000","last_fullsized":"2024-09-16T16:59:52.916680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.239538+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:59:48.239538+0000","last_peered":"2024-09-16T16:59:48.239538+0000","last_clean":"2024-09-16T16:59:48.239538+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:59:48.239538+0000","last_undegraded":"2024-09-16T16:59:48.239538+0000","last_fullsized":"2024-09-16T16:59:48.239538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"80'16","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.432991+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T16:59:53.432991+0000","last_peered":"2024-09-16T16:59:53.432991+0000","last_clean":"2024-09-16T16:59:53.432991+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T16:59:53.432991+0000","last_undegraded":"2024-09-16T16:59:53.432991+0000","last_fullsized":"2024-09-16T16:59:53.432991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240192+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:59:48.240192+0000","last_peered":"2024-09-16T16:59:48.240192+0000","last_clean":"2024-09-16T16:59:48.240192+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:59:48.240192+0000","last_undegraded":"2024-09-16T16:59:48.240192+0000","last_fullsized":"2024-09-16T16:59:48.240192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"80'48","reported_seq":60,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.302582+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T16:59:53.302582+0000","last_peered":"2024-09-16T16:59:53.302582+0000","last_clean":"2024-09-16T16:59:53.302582+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T16:59:53.302582+0000","last_undegraded":"2024-09-16T16:59:53.302582+0000","last_fullsized":"2024-09-16T16:59:53.302582+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250969+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:59:48.250969+0000","last_peered":"2024-09-16T16:59:48.250969+0000","last_clean":"2024-09-16T16:59:48.250969+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:59:48.250969+0000","last_undegraded":"2024-09-16T16:59:48.250969+0000","last_fullsized":"2024-09-16T16:59:48.250969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.858941+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T16:59:53.858941+0000","last_peered":"2024-09-16T16:59:53.858941+0000","last_clean":"2024-09-16T16:59:53.858941+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T16:59:53.858941+0000","last_undegraded":"2024-09-16T16:59:53.858941+0000","last_fullsized":"2024-09-16T16:59:53.858941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.245594+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:59:48.245594+0000","last_peered":"2024-09-16T16:59:48.245594+0000","last_clean":"2024-09-16T16:59:48.245594+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:59:48.245594+0000","last_undegraded":"2024-09-16T16:59:48.245594+0000","last_fullsized":"2024-09-16T16:59:48.245594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:52.228339+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T16:59:52.228339+0000","last_peered":"2024-09-16T16:59:52.228339+0000","last_clean":"2024-09-16T16:59:52.228339+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T16:59:52.228339+0000","last_undegraded":"2024-09-16T16:59:52.228339+0000","last_fullsized":"2024-09-16T16:59:52.228339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.247773+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:59:48.247773+0000","last_peered":"2024-09-16T16:59:48.247773+0000","last_clean":"2024-09-16T16:59:48.247773+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:59:48.247773+0000","last_undegraded":"2024-09-16T16:59:48.247773+0000","last_fullsized":"2024-09-16T16:59:48.247773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"80'32","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:53.674778+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T16:59:53.674778+0000","last_peered":"2024-09-16T16:59:53.674778+0000","last_clean":"2024-09-16T16:59:53.674778+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T16:59:53.674778+0000","last_undegraded":"2024-09-16T16:59:53.674778+0000","last_fullsized":"2024-09-16T16:59:53.674778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.244626+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:59:48.244626+0000","last_peered":"2024-09-16T16:59:48.244626+0000","last_clean":"2024-09-16T16:59:48.244626+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:59:48.244626+0000","last_undegraded":"2024-09-16T16:59:48.244626+0000","last_fullsized":"2024-09-16T16:59:48.244626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":5103616,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214169235456,"internally_reserved":0,"allocated":42258432,"data_stored":42258432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":623,"ondisk_log_size":623,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214169251840,"internally_reserved":0,"allocated":42242048,"data_stored":42242048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8772,"kb_used_data":8772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52288956,"statfs":{"total":53552873472,"available":53543890944,"internally_reserved":0,"allocated":8982528,"data_stored":8982528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":11924,"kb_used_data":11924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52285804,"statfs":{"total":53552873472,"available":53540663296,"internally_reserved":0,"allocated":12210176,"data_stored":12210176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":8432,"kb_used_data":8432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52289296,"statfs":{"total":53552873472,"available":53544239104,"internally_reserved":0,"allocated":8634368,"data_stored":8634368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":10532,"kb_used_data":10532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52287196,"statfs":{"total":53552873472,"available":53542088704,"internally_reserved":0,"allocated":10784768,"data_stored":10784768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53541957632,"internally_reserved":0,"allocated":10915840,"data_stored":10915840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53543514112,"internally_reserved":0,"allocated":9359360,"data_stored":9359360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53540298752,"internally_reserved":0,"allocated":12574720,"data_stored":12574720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53541957632,"internally_reserved":0,"allocated":10915840,"data_stored":10915840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53543497728,"internally_reserved":0,"allocated":9375744,"data_stored":9375744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53540298752,"internally_reserved":0,"allocated":12574720,"data_stored":12574720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53543481344,"internally_reserved":0,"allocated":9392128,"data_stored":9392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:16.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:16.240+0000 7f5d5e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:16.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:16.250+0000 7f5d5e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:16.313 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 28 16 2782 2766 0.771687 0.6875 0.231254 0.161072 2024-09-16T17:00:17.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 29 16 2878 2862 0.770937 0.75 0.0589924 0.161375 2024-09-16T17:00:18.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 30 16 2986 2970 0.773363 0.84375 0.224256 0.161212 2024-09-16T17:00:18.523 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:18.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:18.647+0000 7f332c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:18.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:18.657+0000 7f332c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:19.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 31 16 3100 3084 0.777142 0.890625 0.121682 0.1604 2024-09-16T17:00:20.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 32 16 3180 3164 0.772386 0.625 0.165415 0.161318 2024-09-16T17:00:20.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.121+0000 7fda9d951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.129+0000 7fda9d951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.178 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:21.178 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:21.178 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:00:21.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:00:21.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 33 16 3275 3259 0.771469 0.742188 0.141894 0.161455 2024-09-16T17:00:21.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.313+0000 7f87b3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.325+0000 7f87b3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:21.452 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:21.455 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:21.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:00:21.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.580+0000 7f0da8697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.591+0000 7f0da8697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.612 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:21.613 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:21.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:21.617 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:21.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:00:21.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.734+0000 7f85c7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.745+0000 7f85c7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:21.806 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:21.807 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:21.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:21.809 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:21.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:00:21.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.971+0000 7f9a54f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:21.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:21.983+0000 7f9a54f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:22.004 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:22.005 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:22.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:22.008 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:22.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 34 16 3359 3343 0.768078 0.65625 0.0790133 0.162257 2024-09-16T17:00:23.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 35 16 3467 3451 0.770238 0.84375 0.232723 0.161751 2024-09-16T17:00:23.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:23.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:23.478+0000 7f74804fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:23.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:23.485+0000 7f74804fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:24.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 36 16 3569 3553 0.770976 0.796875 0.102479 0.161769 2024-09-16T17:00:25.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 37 16 3689 3673 0.775474 0.9375 0.115838 0.160911 2024-09-16T17:00:25.710 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:25.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:25.846+0000 7f2787d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:25.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:25.858+0000 7f2787d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:26.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 38 16 3790 3774 0.77583 0.789062 0.0549982 0.160638 2024-09-16T17:00:27.008 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:27.009 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:27.009 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:00:27.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:00:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.157+0000 7f3604991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.170+0000 7f3604991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.260 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:27.260 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:27.260 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:27.260 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:27.260 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:27.260 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:27.261 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:27.264 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:27.264 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:27.264 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:00:27.314 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 39 16 3896 3880 0.777169 0.828125 0.359038 0.160088 2024-09-16T17:00:27.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.397+0000 7f132f274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.414+0000 7f132f274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:27.492 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:27.492 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:27.495 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:27.496 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:27.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:00:27.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.659+0000 7f4a6a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.671+0000 7f4a6a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:27.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:27.716 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:27.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:00:27.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.846+0000 7fe5a1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:27.858+0000 7fe5a1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:27.970 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:27.970 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:27.970 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:27.970 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:27.971 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:27.974 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:27.975 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:28.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:28.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:28.211+0000 7fbf618fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:28.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:28.219+0000 7fbf618fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:28.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T17:00:28.314998+0000 min lat: 0.0210356 max lat: 0.65244 avg lat: 0.160032 2024-09-16T17:00:28.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T17:00:28.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 40 16 4009 3993 0.779808 0.882812 0.13313 0.160032 2024-09-16T17:00:29.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 41 16 4104 4088 0.778889 0.742188 0.251292 0.160024 2024-09-16T17:00:30.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 42 16 4213 4197 0.780617 0.851562 0.201773 0.159767 2024-09-16T17:00:30.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:30.605+0000 7fb844991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:30.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:30.613+0000 7fb844991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:31.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 43 16 4309 4293 0.779903 0.75 0.220992 0.159956 2024-09-16T17:00:32.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 44 16 4402 4386 0.778689 0.726562 0.27028 0.160038 2024-09-16T17:00:32.866 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:32.976 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:32.976 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:32.976 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:00:32.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:00:33.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.004+0000 7f005df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.012+0000 7f005df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.146+0000 7fb296ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.158+0000 7fb296ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.217 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:33.217 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:33.217 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:33.217 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:33.217 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:33.218 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:33.218 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:33.218 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:33.218 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:33.218 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:33.218 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:33.218 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:33.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:33.221 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:33.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:00:33.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 45 16 4494 4478 0.777355 0.71875 0.291068 0.160223 2024-09-16T17:00:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.386+0000 7f55a3151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.398+0000 7f55a3151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:33.465 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:33.467 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:33.468 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:33.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:00:33.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.643+0000 7ff7234fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.660+0000 7ff7234fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:33.702 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:33.703 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:33.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:00:33.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.841+0000 7ff34b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:33.852+0000 7ff34b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:00:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:00:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:00:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:00:33.918 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:00:33.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:00:33.922 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:00:34.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 46 16 4598 4582 0.778117 0.8125 0.207583 0.160214 2024-09-16T17:00:35.315 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 47 16 4697 4681 0.778016 0.773438 0.0537471 0.160401 2024-09-16T17:00:35.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:35.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:35.493+0000 7f3611391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:35.501+0000 7f3611391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:36.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 48 16 4784 4768 0.775966 0.679688 0.258508 0.160664 2024-09-16T17:00:37.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 49 16 4885 4869 0.776232 0.789062 0.144028 0.16076 2024-09-16T17:00:37.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:37.887+0000 7f2e7e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:37.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:37.895+0000 7f2e7e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:38.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 50 16 4978 4962 0.775237 0.726562 0.148763 0.16106 2024-09-16T17:00:38.922 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:38.922 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:38.923 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:39.038+0000 7fc9b6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:39.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:39.048+0000 7fc9b6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:39.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 51 16 5040 5024 0.769533 0.484375 0.121078 0.162166 2024-09-16T17:00:39.322 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:00:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:00:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":483,"stamp":"2024-09-16T17:00:38.522375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29884979,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3657,"num_write_kb":29716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":182132,"kb_used_data":182132,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209008780,"statfs":{"total":214211493888,"available":214024990720,"internally_reserved":0,"allocated":186503168,"data_stored":186503168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002448"},"pg_stats":[{"pgid":"10.7","version":"80'304","reported_seq":316,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.185393+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:24.185393+0000","last_peered":"2024-09-16T17:00:24.185393+0000","last_clean":"2024-09-16T17:00:24.185393+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:24.185393+0000","last_undegraded":"2024-09-16T17:00:24.185393+0000","last_fullsized":"2024-09-16T17:00:24.185393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"80'344","reported_seq":356,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.380696+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:23.380696+0000","last_peered":"2024-09-16T17:00:23.380696+0000","last_clean":"2024-09-16T17:00:23.380696+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:23.380696+0000","last_undegraded":"2024-09-16T17:00:23.380696+0000","last_fullsized":"2024-09-16T17:00:23.380696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"80'216","reported_seq":228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.479899+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:23.479899+0000","last_peered":"2024-09-16T17:00:23.479899+0000","last_clean":"2024-09-16T17:00:23.479899+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:23.479899+0000","last_undegraded":"2024-09-16T17:00:23.479899+0000","last_fullsized":"2024-09-16T17:00:23.479899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.957961+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:20.957961+0000","last_peered":"2024-09-16T17:00:20.957961+0000","last_clean":"2024-09-16T17:00:20.957961+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:20.957961+0000","last_undegraded":"2024-09-16T17:00:20.957961+0000","last_fullsized":"2024-09-16T17:00:20.957961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"80'240","reported_seq":252,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.387510+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:24.387510+0000","last_peered":"2024-09-16T17:00:24.387510+0000","last_clean":"2024-09-16T17:00:24.387510+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:24.387510+0000","last_undegraded":"2024-09-16T17:00:24.387510+0000","last_fullsized":"2024-09-16T17:00:24.387510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.781610+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:22.781610+0000","last_peered":"2024-09-16T17:00:22.781610+0000","last_clean":"2024-09-16T17:00:22.781610+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:22.781610+0000","last_undegraded":"2024-09-16T17:00:22.781610+0000","last_fullsized":"2024-09-16T17:00:22.781610+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.160111+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:20.160111+0000","last_peered":"2024-09-16T17:00:20.160111+0000","last_clean":"2024-09-16T17:00:20.160111+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:20.160111+0000","last_undegraded":"2024-09-16T17:00:20.160111+0000","last_fullsized":"2024-09-16T17:00:20.160111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"80'224","reported_seq":236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.009987+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:24.009987+0000","last_peered":"2024-09-16T17:00:24.009987+0000","last_clean":"2024-09-16T17:00:24.009987+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:24.009987+0000","last_undegraded":"2024-09-16T17:00:24.009987+0000","last_fullsized":"2024-09-16T17:00:24.009987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.832855+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:20.832855+0000","last_peered":"2024-09-16T17:00:20.832855+0000","last_clean":"2024-09-16T17:00:20.832855+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:20.832855+0000","last_undegraded":"2024-09-16T17:00:20.832855+0000","last_fullsized":"2024-09-16T17:00:20.832855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240375+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:59:48.240375+0000","last_peered":"2024-09-16T16:59:48.240375+0000","last_clean":"2024-09-16T16:59:48.240375+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:59:48.240375+0000","last_undegraded":"2024-09-16T16:59:48.240375+0000","last_fullsized":"2024-09-16T16:59:48.240375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.248414+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:59:48.248414+0000","last_peered":"2024-09-16T16:59:48.248414+0000","last_clean":"2024-09-16T16:59:48.248414+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:59:48.248414+0000","last_undegraded":"2024-09-16T16:59:48.248414+0000","last_fullsized":"2024-09-16T16:59:48.248414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.617827+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:22.617827+0000","last_peered":"2024-09-16T17:00:22.617827+0000","last_clean":"2024-09-16T17:00:22.617827+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:22.617827+0000","last_undegraded":"2024-09-16T17:00:22.617827+0000","last_fullsized":"2024-09-16T17:00:22.617827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250640+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:59:48.250640+0000","last_peered":"2024-09-16T16:59:48.250640+0000","last_clean":"2024-09-16T16:59:48.250640+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:59:48.250640+0000","last_undegraded":"2024-09-16T16:59:48.250640+0000","last_fullsized":"2024-09-16T16:59:48.250640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"80'152","reported_seq":164,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.923196+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:22.923196+0000","last_peered":"2024-09-16T17:00:22.923196+0000","last_clean":"2024-09-16T17:00:22.923196+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:22.923196+0000","last_undegraded":"2024-09-16T17:00:22.923196+0000","last_fullsized":"2024-09-16T17:00:22.923196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.239538+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:59:48.239538+0000","last_peered":"2024-09-16T16:59:48.239538+0000","last_clean":"2024-09-16T16:59:48.239538+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:59:48.239538+0000","last_undegraded":"2024-09-16T16:59:48.239538+0000","last_fullsized":"2024-09-16T16:59:48.239538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"80'232","reported_seq":244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.261933+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:24.261933+0000","last_peered":"2024-09-16T17:00:24.261933+0000","last_clean":"2024-09-16T17:00:24.261933+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:24.261933+0000","last_undegraded":"2024-09-16T17:00:24.261933+0000","last_fullsized":"2024-09-16T17:00:24.261933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240192+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:59:48.240192+0000","last_peered":"2024-09-16T16:59:48.240192+0000","last_clean":"2024-09-16T16:59:48.240192+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:59:48.240192+0000","last_undegraded":"2024-09-16T16:59:48.240192+0000","last_fullsized":"2024-09-16T16:59:48.240192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"80'312","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.323220+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:24.323220+0000","last_peered":"2024-09-16T17:00:24.323220+0000","last_clean":"2024-09-16T17:00:24.323220+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:24.323220+0000","last_undegraded":"2024-09-16T17:00:24.323220+0000","last_fullsized":"2024-09-16T17:00:24.323220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250969+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:59:48.250969+0000","last_peered":"2024-09-16T16:59:48.250969+0000","last_clean":"2024-09-16T16:59:48.250969+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:59:48.250969+0000","last_undegraded":"2024-09-16T16:59:48.250969+0000","last_fullsized":"2024-09-16T16:59:48.250969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:21.915481+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:21.915481+0000","last_peered":"2024-09-16T17:00:21.915481+0000","last_clean":"2024-09-16T17:00:21.915481+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:21.915481+0000","last_undegraded":"2024-09-16T17:00:21.915481+0000","last_fullsized":"2024-09-16T17:00:21.915481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.245594+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:59:48.245594+0000","last_peered":"2024-09-16T16:59:48.245594+0000","last_clean":"2024-09-16T16:59:48.245594+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:59:48.245594+0000","last_undegraded":"2024-09-16T16:59:48.245594+0000","last_fullsized":"2024-09-16T16:59:48.245594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.951330+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:23.951330+0000","last_peered":"2024-09-16T17:00:23.951330+0000","last_clean":"2024-09-16T17:00:23.951330+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:23.951330+0000","last_undegraded":"2024-09-16T17:00:23.951330+0000","last_fullsized":"2024-09-16T17:00:23.951330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.247773+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:59:48.247773+0000","last_peered":"2024-09-16T16:59:48.247773+0000","last_clean":"2024-09-16T16:59:48.247773+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:59:48.247773+0000","last_undegraded":"2024-09-16T16:59:48.247773+0000","last_fullsized":"2024-09-16T16:59:48.247773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:16.089415+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:16.089415+0000","last_peered":"2024-09-16T17:00:16.089415+0000","last_clean":"2024-09-16T17:00:16.089415+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:16.089415+0000","last_undegraded":"2024-09-16T17:00:16.089415+0000","last_fullsized":"2024-09-16T17:00:16.089415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.244626+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:59:48.244626+0000","last_peered":"2024-09-16T16:59:48.244626+0000","last_clean":"2024-09-16T16:59:48.244626+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:59:48.244626+0000","last_undegraded":"2024-09-16T16:59:48.244626+0000","last_fullsized":"2024-09-16T16:59:48.244626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3576,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022586368,"internally_reserved":0,"allocated":188907520,"data_stored":188907520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3576,"ondisk_log_size":3576,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022594560,"internally_reserved":0,"allocated":188899328,"data_stored":188899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34272,"kb_used_data":34272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52263456,"statfs":{"total":53552873472,"available":53517778944,"internally_reserved":0,"allocated":35094528,"data_stored":35094528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":54524,"kb_used_data":54524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52243204,"statfs":{"total":53552873472,"available":53497040896,"internally_reserved":0,"allocated":55832576,"data_stored":55832576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42412,"kb_used_data":42412,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52255316,"statfs":{"total":53552873472,"available":53509443584,"internally_reserved":0,"allocated":43429888,"data_stored":43429888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":50924,"kb_used_data":50924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52246804,"statfs":{"total":53552873472,"available":53500727296,"internally_reserved":0,"allocated":52146176,"data_stored":52146176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53500219392,"internally_reserved":0,"allocated":52654080,"data_stored":52654080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53500211200,"internally_reserved":0,"allocated":52662272,"data_stored":52662272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:40.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:40.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 52 15 5152 5137 0.77171 0.882812 0.196242 0.161688 2024-09-16T17:00:40.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:40.405+0000 7f1470391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:40.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:40.414+0000 7f1470391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:41.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 53 16 5265 5249 0.773658 0.875 0.128977 0.161313 2024-09-16T17:00:42.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 54 16 5369 5353 0.774375 0.8125 0.095856 0.161221 2024-09-16T17:00:42.673 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:42.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:42.798+0000 7fdcdda7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:42.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:42.807+0000 7fdcdda7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:43.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 55 16 5466 5450 0.774073 0.757812 0.111997 0.161321 2024-09-16T17:00:44.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 56 16 5559 5543 0.773223 0.726562 0.0615534 0.161515 2024-09-16T17:00:44.348 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:44.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:00:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:44.524+0000 7f7ac50d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:44.544+0000 7f7ac50d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:45.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:45.233+0000 7fd3416bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:45.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:45.241+0000 7fd3416bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:45.294 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:00:45.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:00:45.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 57 16 5650 5634 0.77213 0.710938 0.0779061 0.161552 2024-09-16T17:00:45.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:45.433+0000 7f11a8a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:45.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:45.446+0000 7f11a8a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:00:46.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 58 16 5727 5711 0.769188 0.601562 0.292585 0.162215 2024-09-16T17:00:46.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:00:46.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:46.482+0000 7f4e7a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:46.497+0000 7f4e7a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:47.305 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:00:47.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 59 16 5823 5807 0.768861 0.75 0.189527 0.162201 2024-09-16T17:00:47.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:00:47.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:47.451+0000 7ff4efcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:47.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:47.464+0000 7ff4efcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:47.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:47.610+0000 7f49d1c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:47.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:47.620+0000 7f49d1c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:48.310 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:00:48.316 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T17:00:48.316921+0000 min lat: 0.0210356 max lat: 0.830642 avg lat: 0.162576 2024-09-16T17:00:48.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T17:00:48.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 60 16 5912 5896 0.767635 0.695312 0.140316 0.162576 2024-09-16T17:00:48.330 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:00:48.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:48.505+0000 7f9557551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:48.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:48.516+0000 7f9557551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:48.727 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:00:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:00:48.743 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2024-09-16T17:00:48.524149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29884979,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3657,"num_write_kb":29716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":182132,"kb_used_data":182132,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209008780,"statfs":{"total":214211493888,"available":214024990720,"internally_reserved":0,"allocated":186503168,"data_stored":186503168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000768"},"pg_stats":[{"pgid":"10.7","version":"80'304","reported_seq":316,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.185393+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:24.185393+0000","last_peered":"2024-09-16T17:00:24.185393+0000","last_clean":"2024-09-16T17:00:24.185393+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:24.185393+0000","last_undegraded":"2024-09-16T17:00:24.185393+0000","last_fullsized":"2024-09-16T17:00:24.185393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"80'344","reported_seq":356,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.380696+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:23.380696+0000","last_peered":"2024-09-16T17:00:23.380696+0000","last_clean":"2024-09-16T17:00:23.380696+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:23.380696+0000","last_undegraded":"2024-09-16T17:00:23.380696+0000","last_fullsized":"2024-09-16T17:00:23.380696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"80'216","reported_seq":228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.479899+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:23.479899+0000","last_peered":"2024-09-16T17:00:23.479899+0000","last_clean":"2024-09-16T17:00:23.479899+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:23.479899+0000","last_undegraded":"2024-09-16T17:00:23.479899+0000","last_fullsized":"2024-09-16T17:00:23.479899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.957961+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:20.957961+0000","last_peered":"2024-09-16T17:00:20.957961+0000","last_clean":"2024-09-16T17:00:20.957961+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:20.957961+0000","last_undegraded":"2024-09-16T17:00:20.957961+0000","last_fullsized":"2024-09-16T17:00:20.957961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"80'240","reported_seq":252,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.387510+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:24.387510+0000","last_peered":"2024-09-16T17:00:24.387510+0000","last_clean":"2024-09-16T17:00:24.387510+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:24.387510+0000","last_undegraded":"2024-09-16T17:00:24.387510+0000","last_fullsized":"2024-09-16T17:00:24.387510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.781610+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:22.781610+0000","last_peered":"2024-09-16T17:00:22.781610+0000","last_clean":"2024-09-16T17:00:22.781610+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:22.781610+0000","last_undegraded":"2024-09-16T17:00:22.781610+0000","last_fullsized":"2024-09-16T17:00:22.781610+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.160111+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:20.160111+0000","last_peered":"2024-09-16T17:00:20.160111+0000","last_clean":"2024-09-16T17:00:20.160111+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:20.160111+0000","last_undegraded":"2024-09-16T17:00:20.160111+0000","last_fullsized":"2024-09-16T17:00:20.160111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"80'224","reported_seq":236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.009987+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:24.009987+0000","last_peered":"2024-09-16T17:00:24.009987+0000","last_clean":"2024-09-16T17:00:24.009987+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:24.009987+0000","last_undegraded":"2024-09-16T17:00:24.009987+0000","last_fullsized":"2024-09-16T17:00:24.009987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.832855+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:20.832855+0000","last_peered":"2024-09-16T17:00:20.832855+0000","last_clean":"2024-09-16T17:00:20.832855+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:20.832855+0000","last_undegraded":"2024-09-16T17:00:20.832855+0000","last_fullsized":"2024-09-16T17:00:20.832855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240375+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:59:48.240375+0000","last_peered":"2024-09-16T16:59:48.240375+0000","last_clean":"2024-09-16T16:59:48.240375+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:59:48.240375+0000","last_undegraded":"2024-09-16T16:59:48.240375+0000","last_fullsized":"2024-09-16T16:59:48.240375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.248414+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:59:48.248414+0000","last_peered":"2024-09-16T16:59:48.248414+0000","last_clean":"2024-09-16T16:59:48.248414+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:59:48.248414+0000","last_undegraded":"2024-09-16T16:59:48.248414+0000","last_fullsized":"2024-09-16T16:59:48.248414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.617827+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:22.617827+0000","last_peered":"2024-09-16T17:00:22.617827+0000","last_clean":"2024-09-16T17:00:22.617827+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:22.617827+0000","last_undegraded":"2024-09-16T17:00:22.617827+0000","last_fullsized":"2024-09-16T17:00:22.617827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250640+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:59:48.250640+0000","last_peered":"2024-09-16T16:59:48.250640+0000","last_clean":"2024-09-16T16:59:48.250640+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:59:48.250640+0000","last_undegraded":"2024-09-16T16:59:48.250640+0000","last_fullsized":"2024-09-16T16:59:48.250640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"80'152","reported_seq":164,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.923196+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:22.923196+0000","last_peered":"2024-09-16T17:00:22.923196+0000","last_clean":"2024-09-16T17:00:22.923196+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:22.923196+0000","last_undegraded":"2024-09-16T17:00:22.923196+0000","last_fullsized":"2024-09-16T17:00:22.923196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.239538+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:59:48.239538+0000","last_peered":"2024-09-16T16:59:48.239538+0000","last_clean":"2024-09-16T16:59:48.239538+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:59:48.239538+0000","last_undegraded":"2024-09-16T16:59:48.239538+0000","last_fullsized":"2024-09-16T16:59:48.239538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"80'232","reported_seq":244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.261933+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:24.261933+0000","last_peered":"2024-09-16T17:00:24.261933+0000","last_clean":"2024-09-16T17:00:24.261933+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:24.261933+0000","last_undegraded":"2024-09-16T17:00:24.261933+0000","last_fullsized":"2024-09-16T17:00:24.261933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240192+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:59:48.240192+0000","last_peered":"2024-09-16T16:59:48.240192+0000","last_clean":"2024-09-16T16:59:48.240192+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:59:48.240192+0000","last_undegraded":"2024-09-16T16:59:48.240192+0000","last_fullsized":"2024-09-16T16:59:48.240192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"80'312","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.323220+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:24.323220+0000","last_peered":"2024-09-16T17:00:24.323220+0000","last_clean":"2024-09-16T17:00:24.323220+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:24.323220+0000","last_undegraded":"2024-09-16T17:00:24.323220+0000","last_fullsized":"2024-09-16T17:00:24.323220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250969+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:59:48.250969+0000","last_peered":"2024-09-16T16:59:48.250969+0000","last_clean":"2024-09-16T16:59:48.250969+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:59:48.250969+0000","last_undegraded":"2024-09-16T16:59:48.250969+0000","last_fullsized":"2024-09-16T16:59:48.250969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:21.915481+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:21.915481+0000","last_peered":"2024-09-16T17:00:21.915481+0000","last_clean":"2024-09-16T17:00:21.915481+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:21.915481+0000","last_undegraded":"2024-09-16T17:00:21.915481+0000","last_fullsized":"2024-09-16T17:00:21.915481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.245594+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:59:48.245594+0000","last_peered":"2024-09-16T16:59:48.245594+0000","last_clean":"2024-09-16T16:59:48.245594+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:59:48.245594+0000","last_undegraded":"2024-09-16T16:59:48.245594+0000","last_fullsized":"2024-09-16T16:59:48.245594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.951330+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:23.951330+0000","last_peered":"2024-09-16T17:00:23.951330+0000","last_clean":"2024-09-16T17:00:23.951330+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:23.951330+0000","last_undegraded":"2024-09-16T17:00:23.951330+0000","last_fullsized":"2024-09-16T17:00:23.951330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.247773+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:59:48.247773+0000","last_peered":"2024-09-16T16:59:48.247773+0000","last_clean":"2024-09-16T16:59:48.247773+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:59:48.247773+0000","last_undegraded":"2024-09-16T16:59:48.247773+0000","last_fullsized":"2024-09-16T16:59:48.247773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:16.089415+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:16.089415+0000","last_peered":"2024-09-16T17:00:16.089415+0000","last_clean":"2024-09-16T17:00:16.089415+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:16.089415+0000","last_undegraded":"2024-09-16T17:00:16.089415+0000","last_fullsized":"2024-09-16T17:00:16.089415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.244626+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:59:48.244626+0000","last_peered":"2024-09-16T16:59:48.244626+0000","last_clean":"2024-09-16T16:59:48.244626+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:59:48.244626+0000","last_undegraded":"2024-09-16T16:59:48.244626+0000","last_fullsized":"2024-09-16T16:59:48.244626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3576,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022586368,"internally_reserved":0,"allocated":188907520,"data_stored":188907520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3576,"ondisk_log_size":3576,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022594560,"internally_reserved":0,"allocated":188899328,"data_stored":188899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34272,"kb_used_data":34272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52263456,"statfs":{"total":53552873472,"available":53517778944,"internally_reserved":0,"allocated":35094528,"data_stored":35094528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":54524,"kb_used_data":54524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52243204,"statfs":{"total":53552873472,"available":53497040896,"internally_reserved":0,"allocated":55832576,"data_stored":55832576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42412,"kb_used_data":42412,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52255316,"statfs":{"total":53552873472,"available":53509443584,"internally_reserved":0,"allocated":43429888,"data_stored":43429888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":50924,"kb_used_data":50924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52246804,"statfs":{"total":53552873472,"available":53500727296,"internally_reserved":0,"allocated":52146176,"data_stored":52146176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53500219392,"internally_reserved":0,"allocated":52654080,"data_stored":52654080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53500211200,"internally_reserved":0,"allocated":52662272,"data_stored":52662272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:48.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:48.895+0000 7f033e063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:48.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:48.907+0000 7f033e063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:49.189 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:00:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:00:49.203 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2024-09-16T17:00:48.524149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29884979,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3657,"num_write_kb":29716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":182132,"kb_used_data":182132,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209008780,"statfs":{"total":214211493888,"available":214024990720,"internally_reserved":0,"allocated":186503168,"data_stored":186503168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000768"},"pg_stats":[{"pgid":"10.7","version":"80'304","reported_seq":316,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.185393+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:24.185393+0000","last_peered":"2024-09-16T17:00:24.185393+0000","last_clean":"2024-09-16T17:00:24.185393+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:24.185393+0000","last_undegraded":"2024-09-16T17:00:24.185393+0000","last_fullsized":"2024-09-16T17:00:24.185393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"80'344","reported_seq":356,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.380696+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:23.380696+0000","last_peered":"2024-09-16T17:00:23.380696+0000","last_clean":"2024-09-16T17:00:23.380696+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:23.380696+0000","last_undegraded":"2024-09-16T17:00:23.380696+0000","last_fullsized":"2024-09-16T17:00:23.380696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"80'216","reported_seq":228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.479899+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:23.479899+0000","last_peered":"2024-09-16T17:00:23.479899+0000","last_clean":"2024-09-16T17:00:23.479899+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:23.479899+0000","last_undegraded":"2024-09-16T17:00:23.479899+0000","last_fullsized":"2024-09-16T17:00:23.479899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.957961+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:20.957961+0000","last_peered":"2024-09-16T17:00:20.957961+0000","last_clean":"2024-09-16T17:00:20.957961+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:20.957961+0000","last_undegraded":"2024-09-16T17:00:20.957961+0000","last_fullsized":"2024-09-16T17:00:20.957961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"80'240","reported_seq":252,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.387510+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:24.387510+0000","last_peered":"2024-09-16T17:00:24.387510+0000","last_clean":"2024-09-16T17:00:24.387510+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:24.387510+0000","last_undegraded":"2024-09-16T17:00:24.387510+0000","last_fullsized":"2024-09-16T17:00:24.387510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.781610+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:22.781610+0000","last_peered":"2024-09-16T17:00:22.781610+0000","last_clean":"2024-09-16T17:00:22.781610+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:22.781610+0000","last_undegraded":"2024-09-16T17:00:22.781610+0000","last_fullsized":"2024-09-16T17:00:22.781610+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.160111+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:20.160111+0000","last_peered":"2024-09-16T17:00:20.160111+0000","last_clean":"2024-09-16T17:00:20.160111+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:20.160111+0000","last_undegraded":"2024-09-16T17:00:20.160111+0000","last_fullsized":"2024-09-16T17:00:20.160111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"80'224","reported_seq":236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.009987+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:24.009987+0000","last_peered":"2024-09-16T17:00:24.009987+0000","last_clean":"2024-09-16T17:00:24.009987+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:24.009987+0000","last_undegraded":"2024-09-16T17:00:24.009987+0000","last_fullsized":"2024-09-16T17:00:24.009987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.832855+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:20.832855+0000","last_peered":"2024-09-16T17:00:20.832855+0000","last_clean":"2024-09-16T17:00:20.832855+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:20.832855+0000","last_undegraded":"2024-09-16T17:00:20.832855+0000","last_fullsized":"2024-09-16T17:00:20.832855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240375+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:59:48.240375+0000","last_peered":"2024-09-16T16:59:48.240375+0000","last_clean":"2024-09-16T16:59:48.240375+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:59:48.240375+0000","last_undegraded":"2024-09-16T16:59:48.240375+0000","last_fullsized":"2024-09-16T16:59:48.240375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.248414+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:59:48.248414+0000","last_peered":"2024-09-16T16:59:48.248414+0000","last_clean":"2024-09-16T16:59:48.248414+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:59:48.248414+0000","last_undegraded":"2024-09-16T16:59:48.248414+0000","last_fullsized":"2024-09-16T16:59:48.248414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.617827+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:22.617827+0000","last_peered":"2024-09-16T17:00:22.617827+0000","last_clean":"2024-09-16T17:00:22.617827+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:22.617827+0000","last_undegraded":"2024-09-16T17:00:22.617827+0000","last_fullsized":"2024-09-16T17:00:22.617827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250640+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:59:48.250640+0000","last_peered":"2024-09-16T16:59:48.250640+0000","last_clean":"2024-09-16T16:59:48.250640+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:59:48.250640+0000","last_undegraded":"2024-09-16T16:59:48.250640+0000","last_fullsized":"2024-09-16T16:59:48.250640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"80'152","reported_seq":164,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.923196+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:22.923196+0000","last_peered":"2024-09-16T17:00:22.923196+0000","last_clean":"2024-09-16T17:00:22.923196+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:22.923196+0000","last_undegraded":"2024-09-16T17:00:22.923196+0000","last_fullsized":"2024-09-16T17:00:22.923196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.239538+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:59:48.239538+0000","last_peered":"2024-09-16T16:59:48.239538+0000","last_clean":"2024-09-16T16:59:48.239538+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:59:48.239538+0000","last_undegraded":"2024-09-16T16:59:48.239538+0000","last_fullsized":"2024-09-16T16:59:48.239538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"80'232","reported_seq":244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.261933+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:24.261933+0000","last_peered":"2024-09-16T17:00:24.261933+0000","last_clean":"2024-09-16T17:00:24.261933+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:24.261933+0000","last_undegraded":"2024-09-16T17:00:24.261933+0000","last_fullsized":"2024-09-16T17:00:24.261933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240192+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:59:48.240192+0000","last_peered":"2024-09-16T16:59:48.240192+0000","last_clean":"2024-09-16T16:59:48.240192+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:59:48.240192+0000","last_undegraded":"2024-09-16T16:59:48.240192+0000","last_fullsized":"2024-09-16T16:59:48.240192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"80'312","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.323220+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:24.323220+0000","last_peered":"2024-09-16T17:00:24.323220+0000","last_clean":"2024-09-16T17:00:24.323220+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:24.323220+0000","last_undegraded":"2024-09-16T17:00:24.323220+0000","last_fullsized":"2024-09-16T17:00:24.323220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250969+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:59:48.250969+0000","last_peered":"2024-09-16T16:59:48.250969+0000","last_clean":"2024-09-16T16:59:48.250969+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:59:48.250969+0000","last_undegraded":"2024-09-16T16:59:48.250969+0000","last_fullsized":"2024-09-16T16:59:48.250969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:21.915481+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:21.915481+0000","last_peered":"2024-09-16T17:00:21.915481+0000","last_clean":"2024-09-16T17:00:21.915481+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:21.915481+0000","last_undegraded":"2024-09-16T17:00:21.915481+0000","last_fullsized":"2024-09-16T17:00:21.915481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.245594+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:59:48.245594+0000","last_peered":"2024-09-16T16:59:48.245594+0000","last_clean":"2024-09-16T16:59:48.245594+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:59:48.245594+0000","last_undegraded":"2024-09-16T16:59:48.245594+0000","last_fullsized":"2024-09-16T16:59:48.245594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.951330+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:23.951330+0000","last_peered":"2024-09-16T17:00:23.951330+0000","last_clean":"2024-09-16T17:00:23.951330+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:23.951330+0000","last_undegraded":"2024-09-16T17:00:23.951330+0000","last_fullsized":"2024-09-16T17:00:23.951330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.247773+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:59:48.247773+0000","last_peered":"2024-09-16T16:59:48.247773+0000","last_clean":"2024-09-16T16:59:48.247773+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:59:48.247773+0000","last_undegraded":"2024-09-16T16:59:48.247773+0000","last_fullsized":"2024-09-16T16:59:48.247773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:16.089415+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:16.089415+0000","last_peered":"2024-09-16T17:00:16.089415+0000","last_clean":"2024-09-16T17:00:16.089415+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:16.089415+0000","last_undegraded":"2024-09-16T17:00:16.089415+0000","last_fullsized":"2024-09-16T17:00:16.089415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.244626+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:59:48.244626+0000","last_peered":"2024-09-16T16:59:48.244626+0000","last_clean":"2024-09-16T16:59:48.244626+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:59:48.244626+0000","last_undegraded":"2024-09-16T16:59:48.244626+0000","last_fullsized":"2024-09-16T16:59:48.244626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3576,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022586368,"internally_reserved":0,"allocated":188907520,"data_stored":188907520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3576,"ondisk_log_size":3576,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022594560,"internally_reserved":0,"allocated":188899328,"data_stored":188899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34272,"kb_used_data":34272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52263456,"statfs":{"total":53552873472,"available":53517778944,"internally_reserved":0,"allocated":35094528,"data_stored":35094528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":54524,"kb_used_data":54524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52243204,"statfs":{"total":53552873472,"available":53497040896,"internally_reserved":0,"allocated":55832576,"data_stored":55832576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42412,"kb_used_data":42412,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52255316,"statfs":{"total":53552873472,"available":53509443584,"internally_reserved":0,"allocated":43429888,"data_stored":43429888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":50924,"kb_used_data":50924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52246804,"statfs":{"total":53552873472,"available":53500727296,"internally_reserved":0,"allocated":52146176,"data_stored":52146176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53500219392,"internally_reserved":0,"allocated":52654080,"data_stored":52654080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53500211200,"internally_reserved":0,"allocated":52662272,"data_stored":52662272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:49.205 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:00:49.205 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:49.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:49.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 61 16 5992 5976 0.765295 0.625 0.350585 0.162845 2024-09-16T17:00:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:49.326+0000 7f47f0897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:49.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:49.336+0000 7f47f0897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:49.552 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:00:49.552 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:00:49.568 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2024-09-16T17:00:48.524149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29884979,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3657,"num_write_kb":29716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":182132,"kb_used_data":182132,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209008780,"statfs":{"total":214211493888,"available":214024990720,"internally_reserved":0,"allocated":186503168,"data_stored":186503168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000768"},"pg_stats":[{"pgid":"10.7","version":"80'304","reported_seq":316,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.185393+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:24.185393+0000","last_peered":"2024-09-16T17:00:24.185393+0000","last_clean":"2024-09-16T17:00:24.185393+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:24.185393+0000","last_undegraded":"2024-09-16T17:00:24.185393+0000","last_fullsized":"2024-09-16T17:00:24.185393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"80'344","reported_seq":356,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.380696+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:23.380696+0000","last_peered":"2024-09-16T17:00:23.380696+0000","last_clean":"2024-09-16T17:00:23.380696+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:23.380696+0000","last_undegraded":"2024-09-16T17:00:23.380696+0000","last_fullsized":"2024-09-16T17:00:23.380696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"80'216","reported_seq":228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.479899+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:23.479899+0000","last_peered":"2024-09-16T17:00:23.479899+0000","last_clean":"2024-09-16T17:00:23.479899+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:23.479899+0000","last_undegraded":"2024-09-16T17:00:23.479899+0000","last_fullsized":"2024-09-16T17:00:23.479899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.957961+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:20.957961+0000","last_peered":"2024-09-16T17:00:20.957961+0000","last_clean":"2024-09-16T17:00:20.957961+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:20.957961+0000","last_undegraded":"2024-09-16T17:00:20.957961+0000","last_fullsized":"2024-09-16T17:00:20.957961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"80'240","reported_seq":252,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.387510+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:24.387510+0000","last_peered":"2024-09-16T17:00:24.387510+0000","last_clean":"2024-09-16T17:00:24.387510+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:24.387510+0000","last_undegraded":"2024-09-16T17:00:24.387510+0000","last_fullsized":"2024-09-16T17:00:24.387510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.781610+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:22.781610+0000","last_peered":"2024-09-16T17:00:22.781610+0000","last_clean":"2024-09-16T17:00:22.781610+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:22.781610+0000","last_undegraded":"2024-09-16T17:00:22.781610+0000","last_fullsized":"2024-09-16T17:00:22.781610+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.160111+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:20.160111+0000","last_peered":"2024-09-16T17:00:20.160111+0000","last_clean":"2024-09-16T17:00:20.160111+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:20.160111+0000","last_undegraded":"2024-09-16T17:00:20.160111+0000","last_fullsized":"2024-09-16T17:00:20.160111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"80'224","reported_seq":236,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.009987+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:24.009987+0000","last_peered":"2024-09-16T17:00:24.009987+0000","last_clean":"2024-09-16T17:00:24.009987+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:24.009987+0000","last_undegraded":"2024-09-16T17:00:24.009987+0000","last_fullsized":"2024-09-16T17:00:24.009987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:20.832855+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:20.832855+0000","last_peered":"2024-09-16T17:00:20.832855+0000","last_clean":"2024-09-16T17:00:20.832855+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:20.832855+0000","last_undegraded":"2024-09-16T17:00:20.832855+0000","last_fullsized":"2024-09-16T17:00:20.832855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":280,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240375+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T16:59:48.240375+0000","last_peered":"2024-09-16T16:59:48.240375+0000","last_clean":"2024-09-16T16:59:48.240375+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T16:59:48.240375+0000","last_undegraded":"2024-09-16T16:59:48.240375+0000","last_fullsized":"2024-09-16T16:59:48.240375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.248414+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T16:59:48.248414+0000","last_peered":"2024-09-16T16:59:48.248414+0000","last_clean":"2024-09-16T16:59:48.248414+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T16:59:48.248414+0000","last_undegraded":"2024-09-16T16:59:48.248414+0000","last_fullsized":"2024-09-16T16:59:48.248414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.617827+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:22.617827+0000","last_peered":"2024-09-16T17:00:22.617827+0000","last_clean":"2024-09-16T17:00:22.617827+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:22.617827+0000","last_undegraded":"2024-09-16T17:00:22.617827+0000","last_fullsized":"2024-09-16T17:00:22.617827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250640+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T16:59:48.250640+0000","last_peered":"2024-09-16T16:59:48.250640+0000","last_clean":"2024-09-16T16:59:48.250640+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T16:59:48.250640+0000","last_undegraded":"2024-09-16T16:59:48.250640+0000","last_fullsized":"2024-09-16T16:59:48.250640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"80'152","reported_seq":164,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:22.923196+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:22.923196+0000","last_peered":"2024-09-16T17:00:22.923196+0000","last_clean":"2024-09-16T17:00:22.923196+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:22.923196+0000","last_undegraded":"2024-09-16T17:00:22.923196+0000","last_fullsized":"2024-09-16T17:00:22.923196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.239538+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T16:59:48.239538+0000","last_peered":"2024-09-16T16:59:48.239538+0000","last_clean":"2024-09-16T16:59:48.239538+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T16:59:48.239538+0000","last_undegraded":"2024-09-16T16:59:48.239538+0000","last_fullsized":"2024-09-16T16:59:48.239538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"80'232","reported_seq":244,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.261933+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:24.261933+0000","last_peered":"2024-09-16T17:00:24.261933+0000","last_clean":"2024-09-16T17:00:24.261933+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:24.261933+0000","last_undegraded":"2024-09-16T17:00:24.261933+0000","last_fullsized":"2024-09-16T17:00:24.261933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.240192+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T16:59:48.240192+0000","last_peered":"2024-09-16T16:59:48.240192+0000","last_clean":"2024-09-16T16:59:48.240192+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T16:59:48.240192+0000","last_undegraded":"2024-09-16T16:59:48.240192+0000","last_fullsized":"2024-09-16T16:59:48.240192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"80'312","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:24.323220+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:24.323220+0000","last_peered":"2024-09-16T17:00:24.323220+0000","last_clean":"2024-09-16T17:00:24.323220+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:24.323220+0000","last_undegraded":"2024-09-16T17:00:24.323220+0000","last_fullsized":"2024-09-16T17:00:24.323220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.250969+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T16:59:48.250969+0000","last_peered":"2024-09-16T16:59:48.250969+0000","last_clean":"2024-09-16T16:59:48.250969+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T16:59:48.250969+0000","last_undegraded":"2024-09-16T16:59:48.250969+0000","last_fullsized":"2024-09-16T16:59:48.250969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"80'184","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:21.915481+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:21.915481+0000","last_peered":"2024-09-16T17:00:21.915481+0000","last_clean":"2024-09-16T17:00:21.915481+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:21.915481+0000","last_undegraded":"2024-09-16T17:00:21.915481+0000","last_fullsized":"2024-09-16T17:00:21.915481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.245594+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T16:59:48.245594+0000","last_peered":"2024-09-16T16:59:48.245594+0000","last_clean":"2024-09-16T16:59:48.245594+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T16:59:48.245594+0000","last_undegraded":"2024-09-16T16:59:48.245594+0000","last_fullsized":"2024-09-16T16:59:48.245594+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"80'208","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:23.951330+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:23.951330+0000","last_peered":"2024-09-16T17:00:23.951330+0000","last_clean":"2024-09-16T17:00:23.951330+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:23.951330+0000","last_undegraded":"2024-09-16T17:00:23.951330+0000","last_fullsized":"2024-09-16T17:00:23.951330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.247773+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T16:59:48.247773+0000","last_peered":"2024-09-16T16:59:48.247773+0000","last_clean":"2024-09-16T16:59:48.247773+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T16:59:48.247773+0000","last_undegraded":"2024-09-16T16:59:48.247773+0000","last_fullsized":"2024-09-16T16:59:48.247773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"80'200","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T17:00:16.089415+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:16.089415+0000","last_peered":"2024-09-16T17:00:16.089415+0000","last_clean":"2024-09-16T17:00:16.089415+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:16.089415+0000","last_undegraded":"2024-09-16T17:00:16.089415+0000","last_fullsized":"2024-09-16T17:00:16.089415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-16T16:59:48.244626+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T16:59:48.244626+0000","last_peered":"2024-09-16T16:59:48.244626+0000","last_clean":"2024-09-16T16:59:48.244626+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T16:59:48.244626+0000","last_undegraded":"2024-09-16T16:59:48.244626+0000","last_fullsized":"2024-09-16T16:59:48.244626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3576,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022586368,"internally_reserved":0,"allocated":188907520,"data_stored":188907520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3576,"ondisk_log_size":3576,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214022594560,"internally_reserved":0,"allocated":188899328,"data_stored":188899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":34272,"kb_used_data":34272,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52263456,"statfs":{"total":53552873472,"available":53517778944,"internally_reserved":0,"allocated":35094528,"data_stored":35094528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":54524,"kb_used_data":54524,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52243204,"statfs":{"total":53552873472,"available":53497040896,"internally_reserved":0,"allocated":55832576,"data_stored":55832576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":42412,"kb_used_data":42412,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52255316,"statfs":{"total":53552873472,"available":53509443584,"internally_reserved":0,"allocated":43429888,"data_stored":43429888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":50924,"kb_used_data":50924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52246804,"statfs":{"total":53552873472,"available":53500727296,"internally_reserved":0,"allocated":52146176,"data_stored":52146176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53500219392,"internally_reserved":0,"allocated":52654080,"data_stored":52654080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53500211200,"internally_reserved":0,"allocated":52662272,"data_stored":52662272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53508894720,"internally_reserved":0,"allocated":43978752,"data_stored":43978752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53496303616,"internally_reserved":0,"allocated":56569856,"data_stored":56569856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53517176832,"internally_reserved":0,"allocated":35696640,"data_stored":35696640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:49.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:49.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:49.966+0000 7f71be791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:49.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:49.974+0000 7f71be791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:50.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 62 16 6052 6036 0.760512 0.46875 0.662288 0.163621 2024-09-16T17:00:51.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 63 16 6142 6126 0.7596 0.703125 0.637059 0.16424 2024-09-16T17:00:52.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:52.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 64 16 6239 6223 0.759571 0.757812 0.10948 0.16435 2024-09-16T17:00:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:52.360+0000 7f7d5d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:52.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:52.367+0000 7f7d5d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:53.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 65 16 6325 6309 0.75822 0.671875 0.11319 0.164619 2024-09-16T17:00:54.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 66 16 6413 6397 0.757148 0.6875 0.170349 0.1649 2024-09-16T17:00:54.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:54.570 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:00:54.570 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:00:54.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:00:54.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:54.711+0000 7f764fe6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:54.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:54.722+0000 7f764fe6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:54.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:54.737+0000 7f9577b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:54.754+0000 7f9577b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:55.029 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:00:55.030 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:00:55.046 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2024-09-16T17:00:54.525336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53199411,"num_objects":807,"num_object_clones":0,"num_object_copies":2421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6503,"num_write_kb":52484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6477,"ondisk_log_size":6477,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":325844,"kb_used_data":325844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208865068,"statfs":{"total":214211493888,"available":213877829632,"internally_reserved":0,"allocated":333664256,"data_stored":333664256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23314432,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":22768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001518"},"pg_stats":[{"pgid":"10.7","version":"84'480","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.992720+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:53.992720+0000","last_peered":"2024-09-16T17:00:53.992720+0000","last_clean":"2024-09-16T17:00:53.992720+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:53.992720+0000","last_undegraded":"2024-09-16T17:00:53.992720+0000","last_fullsized":"2024-09-16T17:00:53.992720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"84'472","reported_seq":496,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.445963+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:51.445963+0000","last_peered":"2024-09-16T17:00:51.445963+0000","last_clean":"2024-09-16T17:00:51.445963+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:51.445963+0000","last_undegraded":"2024-09-16T17:00:51.445963+0000","last_fullsized":"2024-09-16T17:00:51.445963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"84'440","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.094605+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:54.094605+0000","last_peered":"2024-09-16T17:00:54.094605+0000","last_clean":"2024-09-16T17:00:54.094605+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:54.094605+0000","last_undegraded":"2024-09-16T17:00:54.094605+0000","last_fullsized":"2024-09-16T17:00:54.094605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.336390+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:54.336390+0000","last_peered":"2024-09-16T17:00:54.336390+0000","last_clean":"2024-09-16T17:00:54.336390+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:54.336390+0000","last_undegraded":"2024-09-16T17:00:54.336390+0000","last_fullsized":"2024-09-16T17:00:54.336390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.149310+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:54.149310+0000","last_peered":"2024-09-16T17:00:54.149310+0000","last_clean":"2024-09-16T17:00:54.149310+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:54.149310+0000","last_undegraded":"2024-09-16T17:00:54.149310+0000","last_fullsized":"2024-09-16T17:00:54.149310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"84'352","reported_seq":376,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.197680+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:52.197680+0000","last_peered":"2024-09-16T17:00:52.197680+0000","last_clean":"2024-09-16T17:00:52.197680+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:52.197680+0000","last_undegraded":"2024-09-16T17:00:52.197680+0000","last_fullsized":"2024-09-16T17:00:52.197680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"84'416","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.736558+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:53.736558+0000","last_peered":"2024-09-16T17:00:53.736558+0000","last_clean":"2024-09-16T17:00:53.736558+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:53.736558+0000","last_undegraded":"2024-09-16T17:00:53.736558+0000","last_fullsized":"2024-09-16T17:00:53.736558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"84'392","reported_seq":416,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.281207+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:53.281207+0000","last_peered":"2024-09-16T17:00:53.281207+0000","last_clean":"2024-09-16T17:00:53.281207+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:53.281207+0000","last_undegraded":"2024-09-16T17:00:53.281207+0000","last_fullsized":"2024-09-16T17:00:53.281207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"84'312","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.545161+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:51.545161+0000","last_peered":"2024-09-16T17:00:51.545161+0000","last_clean":"2024-09-16T17:00:51.545161+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:51.545161+0000","last_undegraded":"2024-09-16T17:00:51.545161+0000","last_fullsized":"2024-09-16T17:00:51.545161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.327112+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:00:48.327112+0000","last_peered":"2024-09-16T17:00:48.327112+0000","last_clean":"2024-09-16T17:00:48.327112+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:00:48.327112+0000","last_undegraded":"2024-09-16T17:00:48.327112+0000","last_fullsized":"2024-09-16T17:00:48.327112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.347361+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:00:48.347361+0000","last_peered":"2024-09-16T17:00:48.347361+0000","last_clean":"2024-09-16T17:00:48.347361+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:00:48.347361+0000","last_undegraded":"2024-09-16T17:00:48.347361+0000","last_fullsized":"2024-09-16T17:00:48.347361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.209093+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:54.209093+0000","last_peered":"2024-09-16T17:00:54.209093+0000","last_clean":"2024-09-16T17:00:54.209093+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:54.209093+0000","last_undegraded":"2024-09-16T17:00:54.209093+0000","last_fullsized":"2024-09-16T17:00:54.209093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.453026+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:00:48.453026+0000","last_peered":"2024-09-16T17:00:48.453026+0000","last_clean":"2024-09-16T17:00:48.453026+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:00:48.453026+0000","last_undegraded":"2024-09-16T17:00:48.453026+0000","last_fullsized":"2024-09-16T17:00:48.453026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"84'304","reported_seq":328,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.356417+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:53.356417+0000","last_peered":"2024-09-16T17:00:53.356417+0000","last_clean":"2024-09-16T17:00:53.356417+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:53.356417+0000","last_undegraded":"2024-09-16T17:00:53.356417+0000","last_fullsized":"2024-09-16T17:00:53.356417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.342511+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:00:48.342511+0000","last_peered":"2024-09-16T17:00:48.342511+0000","last_clean":"2024-09-16T17:00:48.342511+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:00:48.342511+0000","last_undegraded":"2024-09-16T17:00:48.342511+0000","last_fullsized":"2024-09-16T17:00:48.342511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"84'432","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.194008+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:53.194008+0000","last_peered":"2024-09-16T17:00:53.194008+0000","last_clean":"2024-09-16T17:00:53.194008+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:53.194008+0000","last_undegraded":"2024-09-16T17:00:53.194008+0000","last_fullsized":"2024-09-16T17:00:53.194008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":219,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.437366+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:00:48.437366+0000","last_peered":"2024-09-16T17:00:48.437366+0000","last_clean":"2024-09-16T17:00:48.437366+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:00:48.437366+0000","last_undegraded":"2024-09-16T17:00:48.437366+0000","last_fullsized":"2024-09-16T17:00:48.437366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.960238+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:51.960238+0000","last_peered":"2024-09-16T17:00:51.960238+0000","last_clean":"2024-09-16T17:00:51.960238+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:51.960238+0000","last_undegraded":"2024-09-16T17:00:51.960238+0000","last_fullsized":"2024-09-16T17:00:51.960238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.359250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:00:48.359250+0000","last_peered":"2024-09-16T17:00:48.359250+0000","last_clean":"2024-09-16T17:00:48.359250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:00:48.359250+0000","last_undegraded":"2024-09-16T17:00:48.359250+0000","last_fullsized":"2024-09-16T17:00:48.359250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"84'336","reported_seq":360,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.447421+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:52.447421+0000","last_peered":"2024-09-16T17:00:52.447421+0000","last_clean":"2024-09-16T17:00:52.447421+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:52.447421+0000","last_undegraded":"2024-09-16T17:00:52.447421+0000","last_fullsized":"2024-09-16T17:00:52.447421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.334233+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:00:48.334233+0000","last_peered":"2024-09-16T17:00:48.334233+0000","last_clean":"2024-09-16T17:00:48.334233+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:00:48.334233+0000","last_undegraded":"2024-09-16T17:00:48.334233+0000","last_fullsized":"2024-09-16T17:00:48.334233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.267466+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:54.267466+0000","last_peered":"2024-09-16T17:00:54.267466+0000","last_clean":"2024-09-16T17:00:54.267466+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:54.267466+0000","last_undegraded":"2024-09-16T17:00:54.267466+0000","last_fullsized":"2024-09-16T17:00:54.267466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.357928+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:00:48.357928+0000","last_peered":"2024-09-16T17:00:48.357928+0000","last_clean":"2024-09-16T17:00:48.357928+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:00:48.357928+0000","last_undegraded":"2024-09-16T17:00:48.357928+0000","last_fullsized":"2024-09-16T17:00:48.357928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"84'406","reported_seq":430,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.400267+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:54.400267+0000","last_peered":"2024-09-16T17:00:54.400267+0000","last_clean":"2024-09-16T17:00:54.400267+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:54.400267+0000","last_undegraded":"2024-09-16T17:00:54.400267+0000","last_fullsized":"2024-09-16T17:00:54.400267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3325952,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.349901+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:00:48.349901+0000","last_peered":"2024-09-16T17:00:48.349901+0000","last_clean":"2024-09-16T17:00:48.349901+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:00:48.349901+0000","last_undegraded":"2024-09-16T17:00:48.349901+0000","last_fullsized":"2024-09-16T17:00:48.349901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":52609024,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6422,"num_write_kb":51376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875531776,"internally_reserved":0,"allocated":335962112,"data_stored":335962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6422,"ondisk_log_size":6422,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875527680,"internally_reserved":0,"allocated":335966208,"data_stored":335966208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61076,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236652,"statfs":{"total":53552873472,"available":53490331648,"internally_reserved":0,"allocated":62541824,"data_stored":62541824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":97572,"kb_used_data":97572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200156,"statfs":{"total":53552873472,"available":53452959744,"internally_reserved":0,"allocated":99913728,"data_stored":99913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":77324,"kb_used_data":77324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220404,"statfs":{"total":53552873472,"available":53473693696,"internally_reserved":0,"allocated":79179776,"data_stored":79179776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":89872,"kb_used_data":89872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207856,"statfs":{"total":53552873472,"available":53460844544,"internally_reserved":0,"allocated":92028928,"data_stored":92028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53473243136,"internally_reserved":0,"allocated":79630336,"data_stored":79630336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53473247232,"internally_reserved":0,"allocated":79626240,"data_stored":79626240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:00:55.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 67 16 6505 6489 0.756574 0.71875 0.189428 0.165021 2024-09-16T17:00:56.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 68 16 6594 6578 0.755672 0.695312 0.104118 0.165207 2024-09-16T17:00:57.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:00:57.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:57.286+0000 7f2c4746c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:57.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:57.295+0000 7f2c4746c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:57.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 69 16 6697 6681 0.756381 0.804688 0.132799 0.165028 2024-09-16T17:00:58.317 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 70 16 6796 6780 0.756623 0.773438 0.169185 0.164971 2024-09-16T17:00:59.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 71 16 6912 6896 0.75873 0.90625 0.0703356 0.164494 2024-09-16T17:00:59.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:00:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:59.748+0000 7f72f4951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:00:59.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:00:59.759+0000 7f72f4951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:00.049 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:00.049 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:00.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:00.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:00.174+0000 7fec5c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:00.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:00.186+0000 7fec5c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:00.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 72 16 7017 7001 0.759584 0.820312 0.221531 0.164316 2024-09-16T17:01:00.498 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:00.498 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:00.511 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-09-16T17:00:58.526258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53199411,"num_objects":807,"num_object_clones":0,"num_object_copies":2421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6503,"num_write_kb":52484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6477,"ondisk_log_size":6477,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":325844,"kb_used_data":325844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208865068,"statfs":{"total":214211493888,"available":213877829632,"internally_reserved":0,"allocated":333664256,"data_stored":333664256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23314432,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":22768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.215116"},"pg_stats":[{"pgid":"10.7","version":"84'480","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.992720+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:53.992720+0000","last_peered":"2024-09-16T17:00:53.992720+0000","last_clean":"2024-09-16T17:00:53.992720+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:53.992720+0000","last_undegraded":"2024-09-16T17:00:53.992720+0000","last_fullsized":"2024-09-16T17:00:53.992720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"84'472","reported_seq":496,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.445963+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:51.445963+0000","last_peered":"2024-09-16T17:00:51.445963+0000","last_clean":"2024-09-16T17:00:51.445963+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:51.445963+0000","last_undegraded":"2024-09-16T17:00:51.445963+0000","last_fullsized":"2024-09-16T17:00:51.445963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"84'440","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.094605+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:54.094605+0000","last_peered":"2024-09-16T17:00:54.094605+0000","last_clean":"2024-09-16T17:00:54.094605+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:54.094605+0000","last_undegraded":"2024-09-16T17:00:54.094605+0000","last_fullsized":"2024-09-16T17:00:54.094605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.336390+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:54.336390+0000","last_peered":"2024-09-16T17:00:54.336390+0000","last_clean":"2024-09-16T17:00:54.336390+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:54.336390+0000","last_undegraded":"2024-09-16T17:00:54.336390+0000","last_fullsized":"2024-09-16T17:00:54.336390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.149310+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:54.149310+0000","last_peered":"2024-09-16T17:00:54.149310+0000","last_clean":"2024-09-16T17:00:54.149310+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:54.149310+0000","last_undegraded":"2024-09-16T17:00:54.149310+0000","last_fullsized":"2024-09-16T17:00:54.149310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"84'352","reported_seq":376,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.197680+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:52.197680+0000","last_peered":"2024-09-16T17:00:52.197680+0000","last_clean":"2024-09-16T17:00:52.197680+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:52.197680+0000","last_undegraded":"2024-09-16T17:00:52.197680+0000","last_fullsized":"2024-09-16T17:00:52.197680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"84'416","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.736558+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:53.736558+0000","last_peered":"2024-09-16T17:00:53.736558+0000","last_clean":"2024-09-16T17:00:53.736558+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:53.736558+0000","last_undegraded":"2024-09-16T17:00:53.736558+0000","last_fullsized":"2024-09-16T17:00:53.736558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"84'392","reported_seq":416,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.281207+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:53.281207+0000","last_peered":"2024-09-16T17:00:53.281207+0000","last_clean":"2024-09-16T17:00:53.281207+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:53.281207+0000","last_undegraded":"2024-09-16T17:00:53.281207+0000","last_fullsized":"2024-09-16T17:00:53.281207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"84'312","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.545161+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:51.545161+0000","last_peered":"2024-09-16T17:00:51.545161+0000","last_clean":"2024-09-16T17:00:51.545161+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:51.545161+0000","last_undegraded":"2024-09-16T17:00:51.545161+0000","last_fullsized":"2024-09-16T17:00:51.545161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.327112+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:00:48.327112+0000","last_peered":"2024-09-16T17:00:48.327112+0000","last_clean":"2024-09-16T17:00:48.327112+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:00:48.327112+0000","last_undegraded":"2024-09-16T17:00:48.327112+0000","last_fullsized":"2024-09-16T17:00:48.327112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.347361+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:00:48.347361+0000","last_peered":"2024-09-16T17:00:48.347361+0000","last_clean":"2024-09-16T17:00:48.347361+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:00:48.347361+0000","last_undegraded":"2024-09-16T17:00:48.347361+0000","last_fullsized":"2024-09-16T17:00:48.347361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.209093+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:54.209093+0000","last_peered":"2024-09-16T17:00:54.209093+0000","last_clean":"2024-09-16T17:00:54.209093+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:54.209093+0000","last_undegraded":"2024-09-16T17:00:54.209093+0000","last_fullsized":"2024-09-16T17:00:54.209093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.453026+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:00:48.453026+0000","last_peered":"2024-09-16T17:00:48.453026+0000","last_clean":"2024-09-16T17:00:48.453026+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:00:48.453026+0000","last_undegraded":"2024-09-16T17:00:48.453026+0000","last_fullsized":"2024-09-16T17:00:48.453026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"84'304","reported_seq":328,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.356417+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:53.356417+0000","last_peered":"2024-09-16T17:00:53.356417+0000","last_clean":"2024-09-16T17:00:53.356417+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:53.356417+0000","last_undegraded":"2024-09-16T17:00:53.356417+0000","last_fullsized":"2024-09-16T17:00:53.356417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.342511+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:00:48.342511+0000","last_peered":"2024-09-16T17:00:48.342511+0000","last_clean":"2024-09-16T17:00:48.342511+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:00:48.342511+0000","last_undegraded":"2024-09-16T17:00:48.342511+0000","last_fullsized":"2024-09-16T17:00:48.342511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"84'432","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.194008+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:53.194008+0000","last_peered":"2024-09-16T17:00:53.194008+0000","last_clean":"2024-09-16T17:00:53.194008+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:53.194008+0000","last_undegraded":"2024-09-16T17:00:53.194008+0000","last_fullsized":"2024-09-16T17:00:53.194008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":219,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.437366+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:00:48.437366+0000","last_peered":"2024-09-16T17:00:48.437366+0000","last_clean":"2024-09-16T17:00:48.437366+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:00:48.437366+0000","last_undegraded":"2024-09-16T17:00:48.437366+0000","last_fullsized":"2024-09-16T17:00:48.437366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.960238+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:51.960238+0000","last_peered":"2024-09-16T17:00:51.960238+0000","last_clean":"2024-09-16T17:00:51.960238+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:51.960238+0000","last_undegraded":"2024-09-16T17:00:51.960238+0000","last_fullsized":"2024-09-16T17:00:51.960238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.359250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:00:48.359250+0000","last_peered":"2024-09-16T17:00:48.359250+0000","last_clean":"2024-09-16T17:00:48.359250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:00:48.359250+0000","last_undegraded":"2024-09-16T17:00:48.359250+0000","last_fullsized":"2024-09-16T17:00:48.359250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"84'336","reported_seq":360,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.447421+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:52.447421+0000","last_peered":"2024-09-16T17:00:52.447421+0000","last_clean":"2024-09-16T17:00:52.447421+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:52.447421+0000","last_undegraded":"2024-09-16T17:00:52.447421+0000","last_fullsized":"2024-09-16T17:00:52.447421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.334233+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:00:48.334233+0000","last_peered":"2024-09-16T17:00:48.334233+0000","last_clean":"2024-09-16T17:00:48.334233+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:00:48.334233+0000","last_undegraded":"2024-09-16T17:00:48.334233+0000","last_fullsized":"2024-09-16T17:00:48.334233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.267466+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:54.267466+0000","last_peered":"2024-09-16T17:00:54.267466+0000","last_clean":"2024-09-16T17:00:54.267466+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:54.267466+0000","last_undegraded":"2024-09-16T17:00:54.267466+0000","last_fullsized":"2024-09-16T17:00:54.267466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.357928+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:00:48.357928+0000","last_peered":"2024-09-16T17:00:48.357928+0000","last_clean":"2024-09-16T17:00:48.357928+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:00:48.357928+0000","last_undegraded":"2024-09-16T17:00:48.357928+0000","last_fullsized":"2024-09-16T17:00:48.357928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"84'406","reported_seq":430,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.400267+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:54.400267+0000","last_peered":"2024-09-16T17:00:54.400267+0000","last_clean":"2024-09-16T17:00:54.400267+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:54.400267+0000","last_undegraded":"2024-09-16T17:00:54.400267+0000","last_fullsized":"2024-09-16T17:00:54.400267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3325952,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.349901+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:00:48.349901+0000","last_peered":"2024-09-16T17:00:48.349901+0000","last_clean":"2024-09-16T17:00:48.349901+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:00:48.349901+0000","last_undegraded":"2024-09-16T17:00:48.349901+0000","last_fullsized":"2024-09-16T17:00:48.349901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":52609024,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6422,"num_write_kb":51376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875531776,"internally_reserved":0,"allocated":335962112,"data_stored":335962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6422,"ondisk_log_size":6422,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875527680,"internally_reserved":0,"allocated":335966208,"data_stored":335966208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61076,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236652,"statfs":{"total":53552873472,"available":53490331648,"internally_reserved":0,"allocated":62541824,"data_stored":62541824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":97572,"kb_used_data":97572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200156,"statfs":{"total":53552873472,"available":53452959744,"internally_reserved":0,"allocated":99913728,"data_stored":99913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":77324,"kb_used_data":77324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220404,"statfs":{"total":53552873472,"available":53473693696,"internally_reserved":0,"allocated":79179776,"data_stored":79179776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":89872,"kb_used_data":89872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207856,"statfs":{"total":53552873472,"available":53460844544,"internally_reserved":0,"allocated":92028928,"data_stored":92028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53473243136,"internally_reserved":0,"allocated":79630336,"data_stored":79630336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53473247232,"internally_reserved":0,"allocated":79626240,"data_stored":79626240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:01.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 73 16 7118 7102 0.759987 0.789062 0.0919136 0.164175 2024-09-16T17:01:02.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:02.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:02.295+0000 7f80ba07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:02.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:02.303+0000 7f80ba07d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:02.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 74 16 7198 7182 0.758162 0.625 0.402186 0.164528 2024-09-16T17:01:03.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 75 16 7284 7268 0.75701 0.671875 0.0691263 0.164819 2024-09-16T17:01:04.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 76 16 7384 7368 0.757328 0.78125 0.205068 0.164816 2024-09-16T17:01:04.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:04.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:04.780+0000 7fc1f8d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:04.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:04.788+0000 7fc1f8d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:05.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 77 16 7483 7467 0.757537 0.773438 0.169522 0.16482 2024-09-16T17:01:05.513 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:05.513 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:05.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:05.647+0000 7f151f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:05.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:05.658+0000 7f151f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:06.012 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:06.012 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:06.027 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2024-09-16T17:01:04.527465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53199411,"num_objects":807,"num_object_clones":0,"num_object_copies":2421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6503,"num_write_kb":52484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6477,"ondisk_log_size":6477,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":325844,"kb_used_data":325844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208865068,"statfs":{"total":214211493888,"available":213877829632,"internally_reserved":0,"allocated":333664256,"data_stored":333664256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23314432,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":22768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002461"},"pg_stats":[{"pgid":"10.7","version":"84'480","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.992720+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:53.992720+0000","last_peered":"2024-09-16T17:00:53.992720+0000","last_clean":"2024-09-16T17:00:53.992720+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:53.992720+0000","last_undegraded":"2024-09-16T17:00:53.992720+0000","last_fullsized":"2024-09-16T17:00:53.992720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"84'472","reported_seq":496,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.445963+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:51.445963+0000","last_peered":"2024-09-16T17:00:51.445963+0000","last_clean":"2024-09-16T17:00:51.445963+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:51.445963+0000","last_undegraded":"2024-09-16T17:00:51.445963+0000","last_fullsized":"2024-09-16T17:00:51.445963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"84'440","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.094605+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:54.094605+0000","last_peered":"2024-09-16T17:00:54.094605+0000","last_clean":"2024-09-16T17:00:54.094605+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:54.094605+0000","last_undegraded":"2024-09-16T17:00:54.094605+0000","last_fullsized":"2024-09-16T17:00:54.094605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.336390+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:54.336390+0000","last_peered":"2024-09-16T17:00:54.336390+0000","last_clean":"2024-09-16T17:00:54.336390+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:54.336390+0000","last_undegraded":"2024-09-16T17:00:54.336390+0000","last_fullsized":"2024-09-16T17:00:54.336390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.149310+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:54.149310+0000","last_peered":"2024-09-16T17:00:54.149310+0000","last_clean":"2024-09-16T17:00:54.149310+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:54.149310+0000","last_undegraded":"2024-09-16T17:00:54.149310+0000","last_fullsized":"2024-09-16T17:00:54.149310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"84'352","reported_seq":376,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.197680+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:52.197680+0000","last_peered":"2024-09-16T17:00:52.197680+0000","last_clean":"2024-09-16T17:00:52.197680+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:52.197680+0000","last_undegraded":"2024-09-16T17:00:52.197680+0000","last_fullsized":"2024-09-16T17:00:52.197680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"84'416","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.736558+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:53.736558+0000","last_peered":"2024-09-16T17:00:53.736558+0000","last_clean":"2024-09-16T17:00:53.736558+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:53.736558+0000","last_undegraded":"2024-09-16T17:00:53.736558+0000","last_fullsized":"2024-09-16T17:00:53.736558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"84'392","reported_seq":416,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.281207+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:53.281207+0000","last_peered":"2024-09-16T17:00:53.281207+0000","last_clean":"2024-09-16T17:00:53.281207+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:53.281207+0000","last_undegraded":"2024-09-16T17:00:53.281207+0000","last_fullsized":"2024-09-16T17:00:53.281207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"84'312","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.545161+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:51.545161+0000","last_peered":"2024-09-16T17:00:51.545161+0000","last_clean":"2024-09-16T17:00:51.545161+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:51.545161+0000","last_undegraded":"2024-09-16T17:00:51.545161+0000","last_fullsized":"2024-09-16T17:00:51.545161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.327112+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:00:48.327112+0000","last_peered":"2024-09-16T17:00:48.327112+0000","last_clean":"2024-09-16T17:00:48.327112+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:00:48.327112+0000","last_undegraded":"2024-09-16T17:00:48.327112+0000","last_fullsized":"2024-09-16T17:00:48.327112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.347361+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:00:48.347361+0000","last_peered":"2024-09-16T17:00:48.347361+0000","last_clean":"2024-09-16T17:00:48.347361+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:00:48.347361+0000","last_undegraded":"2024-09-16T17:00:48.347361+0000","last_fullsized":"2024-09-16T17:00:48.347361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.209093+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:54.209093+0000","last_peered":"2024-09-16T17:00:54.209093+0000","last_clean":"2024-09-16T17:00:54.209093+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:54.209093+0000","last_undegraded":"2024-09-16T17:00:54.209093+0000","last_fullsized":"2024-09-16T17:00:54.209093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.453026+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:00:48.453026+0000","last_peered":"2024-09-16T17:00:48.453026+0000","last_clean":"2024-09-16T17:00:48.453026+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:00:48.453026+0000","last_undegraded":"2024-09-16T17:00:48.453026+0000","last_fullsized":"2024-09-16T17:00:48.453026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"84'304","reported_seq":328,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.356417+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:53.356417+0000","last_peered":"2024-09-16T17:00:53.356417+0000","last_clean":"2024-09-16T17:00:53.356417+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:53.356417+0000","last_undegraded":"2024-09-16T17:00:53.356417+0000","last_fullsized":"2024-09-16T17:00:53.356417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.342511+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:00:48.342511+0000","last_peered":"2024-09-16T17:00:48.342511+0000","last_clean":"2024-09-16T17:00:48.342511+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:00:48.342511+0000","last_undegraded":"2024-09-16T17:00:48.342511+0000","last_fullsized":"2024-09-16T17:00:48.342511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"84'432","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.194008+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:53.194008+0000","last_peered":"2024-09-16T17:00:53.194008+0000","last_clean":"2024-09-16T17:00:53.194008+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:53.194008+0000","last_undegraded":"2024-09-16T17:00:53.194008+0000","last_fullsized":"2024-09-16T17:00:53.194008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":219,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.437366+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:00:48.437366+0000","last_peered":"2024-09-16T17:00:48.437366+0000","last_clean":"2024-09-16T17:00:48.437366+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:00:48.437366+0000","last_undegraded":"2024-09-16T17:00:48.437366+0000","last_fullsized":"2024-09-16T17:00:48.437366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.960238+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:51.960238+0000","last_peered":"2024-09-16T17:00:51.960238+0000","last_clean":"2024-09-16T17:00:51.960238+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:51.960238+0000","last_undegraded":"2024-09-16T17:00:51.960238+0000","last_fullsized":"2024-09-16T17:00:51.960238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.359250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:00:48.359250+0000","last_peered":"2024-09-16T17:00:48.359250+0000","last_clean":"2024-09-16T17:00:48.359250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:00:48.359250+0000","last_undegraded":"2024-09-16T17:00:48.359250+0000","last_fullsized":"2024-09-16T17:00:48.359250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"84'336","reported_seq":360,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.447421+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:52.447421+0000","last_peered":"2024-09-16T17:00:52.447421+0000","last_clean":"2024-09-16T17:00:52.447421+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:52.447421+0000","last_undegraded":"2024-09-16T17:00:52.447421+0000","last_fullsized":"2024-09-16T17:00:52.447421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.334233+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:00:48.334233+0000","last_peered":"2024-09-16T17:00:48.334233+0000","last_clean":"2024-09-16T17:00:48.334233+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:00:48.334233+0000","last_undegraded":"2024-09-16T17:00:48.334233+0000","last_fullsized":"2024-09-16T17:00:48.334233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.267466+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:54.267466+0000","last_peered":"2024-09-16T17:00:54.267466+0000","last_clean":"2024-09-16T17:00:54.267466+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:54.267466+0000","last_undegraded":"2024-09-16T17:00:54.267466+0000","last_fullsized":"2024-09-16T17:00:54.267466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.357928+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:00:48.357928+0000","last_peered":"2024-09-16T17:00:48.357928+0000","last_clean":"2024-09-16T17:00:48.357928+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:00:48.357928+0000","last_undegraded":"2024-09-16T17:00:48.357928+0000","last_fullsized":"2024-09-16T17:00:48.357928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"84'406","reported_seq":430,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.400267+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:54.400267+0000","last_peered":"2024-09-16T17:00:54.400267+0000","last_clean":"2024-09-16T17:00:54.400267+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:54.400267+0000","last_undegraded":"2024-09-16T17:00:54.400267+0000","last_fullsized":"2024-09-16T17:00:54.400267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3325952,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.349901+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:00:48.349901+0000","last_peered":"2024-09-16T17:00:48.349901+0000","last_clean":"2024-09-16T17:00:48.349901+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:00:48.349901+0000","last_undegraded":"2024-09-16T17:00:48.349901+0000","last_fullsized":"2024-09-16T17:00:48.349901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":52609024,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6422,"num_write_kb":51376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875531776,"internally_reserved":0,"allocated":335962112,"data_stored":335962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6422,"ondisk_log_size":6422,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875527680,"internally_reserved":0,"allocated":335966208,"data_stored":335966208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61076,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236652,"statfs":{"total":53552873472,"available":53490331648,"internally_reserved":0,"allocated":62541824,"data_stored":62541824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":97572,"kb_used_data":97572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200156,"statfs":{"total":53552873472,"available":53452959744,"internally_reserved":0,"allocated":99913728,"data_stored":99913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":77324,"kb_used_data":77324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220404,"statfs":{"total":53552873472,"available":53473693696,"internally_reserved":0,"allocated":79179776,"data_stored":79179776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":89872,"kb_used_data":89872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207856,"statfs":{"total":53552873472,"available":53460844544,"internally_reserved":0,"allocated":92028928,"data_stored":92028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53473243136,"internally_reserved":0,"allocated":79630336,"data_stored":79630336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53473247232,"internally_reserved":0,"allocated":79626240,"data_stored":79626240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:06.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 78 16 7577 7561 0.757238 0.734375 0.401132 0.164768 2024-09-16T17:01:07.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:07.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:07.215+0000 7f0fe74ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:07.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:07.224+0000 7f0fe74ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:07.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 79 16 7684 7668 0.758234 0.835938 0.0563949 0.164581 2024-09-16T17:01:08.318 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:2024-09-16T17:01:08.318910+0000 min lat: 0.0210356 max lat: 0.918164 avg lat: 0.164513 2024-09-16T17:01:08.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T17:01:08.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 80 16 7791 7775 0.759204 0.835938 0.155167 0.164513 2024-09-16T17:01:09.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 81 16 7887 7871 0.759089 0.75 0.153833 0.16452 2024-09-16T17:01:09.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:09.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:09.661+0000 7eff5e2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:09.670+0000 7eff5e2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:10.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 82 16 8001 7985 0.760692 0.890625 0.114194 0.164206 2024-09-16T17:01:11.030 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:11.030 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:11.030 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:11.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:11.168+0000 7fb433991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:11.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:11.181+0000 7fb433991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:11.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 83 16 8102 8086 0.761033 0.789062 0.111144 0.164044 2024-09-16T17:01:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:11.429 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:11.450 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":503,"stamp":"2024-09-16T17:01:10.528580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53199411,"num_objects":807,"num_object_clones":0,"num_object_copies":2421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6503,"num_write_kb":52484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6477,"ondisk_log_size":6477,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":325844,"kb_used_data":325844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208865068,"statfs":{"total":214211493888,"available":213877829632,"internally_reserved":0,"allocated":333664256,"data_stored":333664256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002321"},"pg_stats":[{"pgid":"10.7","version":"84'480","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.992720+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:53.992720+0000","last_peered":"2024-09-16T17:00:53.992720+0000","last_clean":"2024-09-16T17:00:53.992720+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:53.992720+0000","last_undegraded":"2024-09-16T17:00:53.992720+0000","last_fullsized":"2024-09-16T17:00:53.992720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"84'472","reported_seq":496,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.445963+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:51.445963+0000","last_peered":"2024-09-16T17:00:51.445963+0000","last_clean":"2024-09-16T17:00:51.445963+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:51.445963+0000","last_undegraded":"2024-09-16T17:00:51.445963+0000","last_fullsized":"2024-09-16T17:00:51.445963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"84'440","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.094605+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:54.094605+0000","last_peered":"2024-09-16T17:00:54.094605+0000","last_clean":"2024-09-16T17:00:54.094605+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:54.094605+0000","last_undegraded":"2024-09-16T17:00:54.094605+0000","last_fullsized":"2024-09-16T17:00:54.094605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.336390+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:54.336390+0000","last_peered":"2024-09-16T17:00:54.336390+0000","last_clean":"2024-09-16T17:00:54.336390+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:54.336390+0000","last_undegraded":"2024-09-16T17:00:54.336390+0000","last_fullsized":"2024-09-16T17:00:54.336390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.149310+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:54.149310+0000","last_peered":"2024-09-16T17:00:54.149310+0000","last_clean":"2024-09-16T17:00:54.149310+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:54.149310+0000","last_undegraded":"2024-09-16T17:00:54.149310+0000","last_fullsized":"2024-09-16T17:00:54.149310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"84'352","reported_seq":376,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.197680+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:52.197680+0000","last_peered":"2024-09-16T17:00:52.197680+0000","last_clean":"2024-09-16T17:00:52.197680+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:52.197680+0000","last_undegraded":"2024-09-16T17:00:52.197680+0000","last_fullsized":"2024-09-16T17:00:52.197680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"84'416","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.736558+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:53.736558+0000","last_peered":"2024-09-16T17:00:53.736558+0000","last_clean":"2024-09-16T17:00:53.736558+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:53.736558+0000","last_undegraded":"2024-09-16T17:00:53.736558+0000","last_fullsized":"2024-09-16T17:00:53.736558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"84'392","reported_seq":416,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.281207+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:53.281207+0000","last_peered":"2024-09-16T17:00:53.281207+0000","last_clean":"2024-09-16T17:00:53.281207+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:53.281207+0000","last_undegraded":"2024-09-16T17:00:53.281207+0000","last_fullsized":"2024-09-16T17:00:53.281207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"84'312","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.545161+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:51.545161+0000","last_peered":"2024-09-16T17:00:51.545161+0000","last_clean":"2024-09-16T17:00:51.545161+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:51.545161+0000","last_undegraded":"2024-09-16T17:00:51.545161+0000","last_fullsized":"2024-09-16T17:00:51.545161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.327112+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:00:48.327112+0000","last_peered":"2024-09-16T17:00:48.327112+0000","last_clean":"2024-09-16T17:00:48.327112+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:00:48.327112+0000","last_undegraded":"2024-09-16T17:00:48.327112+0000","last_fullsized":"2024-09-16T17:00:48.327112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.347361+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:00:48.347361+0000","last_peered":"2024-09-16T17:00:48.347361+0000","last_clean":"2024-09-16T17:00:48.347361+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:00:48.347361+0000","last_undegraded":"2024-09-16T17:00:48.347361+0000","last_fullsized":"2024-09-16T17:00:48.347361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.209093+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:54.209093+0000","last_peered":"2024-09-16T17:00:54.209093+0000","last_clean":"2024-09-16T17:00:54.209093+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:54.209093+0000","last_undegraded":"2024-09-16T17:00:54.209093+0000","last_fullsized":"2024-09-16T17:00:54.209093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.453026+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:00:48.453026+0000","last_peered":"2024-09-16T17:00:48.453026+0000","last_clean":"2024-09-16T17:00:48.453026+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:00:48.453026+0000","last_undegraded":"2024-09-16T17:00:48.453026+0000","last_fullsized":"2024-09-16T17:00:48.453026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"84'304","reported_seq":328,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.356417+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:53.356417+0000","last_peered":"2024-09-16T17:00:53.356417+0000","last_clean":"2024-09-16T17:00:53.356417+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:53.356417+0000","last_undegraded":"2024-09-16T17:00:53.356417+0000","last_fullsized":"2024-09-16T17:00:53.356417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.342511+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:00:48.342511+0000","last_peered":"2024-09-16T17:00:48.342511+0000","last_clean":"2024-09-16T17:00:48.342511+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:00:48.342511+0000","last_undegraded":"2024-09-16T17:00:48.342511+0000","last_fullsized":"2024-09-16T17:00:48.342511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"84'432","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.194008+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:53.194008+0000","last_peered":"2024-09-16T17:00:53.194008+0000","last_clean":"2024-09-16T17:00:53.194008+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:53.194008+0000","last_undegraded":"2024-09-16T17:00:53.194008+0000","last_fullsized":"2024-09-16T17:00:53.194008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":219,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.437366+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:00:48.437366+0000","last_peered":"2024-09-16T17:00:48.437366+0000","last_clean":"2024-09-16T17:00:48.437366+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:00:48.437366+0000","last_undegraded":"2024-09-16T17:00:48.437366+0000","last_fullsized":"2024-09-16T17:00:48.437366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.960238+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:51.960238+0000","last_peered":"2024-09-16T17:00:51.960238+0000","last_clean":"2024-09-16T17:00:51.960238+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:51.960238+0000","last_undegraded":"2024-09-16T17:00:51.960238+0000","last_fullsized":"2024-09-16T17:00:51.960238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.359250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:00:48.359250+0000","last_peered":"2024-09-16T17:00:48.359250+0000","last_clean":"2024-09-16T17:00:48.359250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:00:48.359250+0000","last_undegraded":"2024-09-16T17:00:48.359250+0000","last_fullsized":"2024-09-16T17:00:48.359250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"84'336","reported_seq":360,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.447421+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:52.447421+0000","last_peered":"2024-09-16T17:00:52.447421+0000","last_clean":"2024-09-16T17:00:52.447421+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:52.447421+0000","last_undegraded":"2024-09-16T17:00:52.447421+0000","last_fullsized":"2024-09-16T17:00:52.447421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.334233+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:00:48.334233+0000","last_peered":"2024-09-16T17:00:48.334233+0000","last_clean":"2024-09-16T17:00:48.334233+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:00:48.334233+0000","last_undegraded":"2024-09-16T17:00:48.334233+0000","last_fullsized":"2024-09-16T17:00:48.334233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.267466+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:54.267466+0000","last_peered":"2024-09-16T17:00:54.267466+0000","last_clean":"2024-09-16T17:00:54.267466+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:54.267466+0000","last_undegraded":"2024-09-16T17:00:54.267466+0000","last_fullsized":"2024-09-16T17:00:54.267466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.357928+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:00:48.357928+0000","last_peered":"2024-09-16T17:00:48.357928+0000","last_clean":"2024-09-16T17:00:48.357928+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:00:48.357928+0000","last_undegraded":"2024-09-16T17:00:48.357928+0000","last_fullsized":"2024-09-16T17:00:48.357928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"84'406","reported_seq":430,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.400267+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:54.400267+0000","last_peered":"2024-09-16T17:00:54.400267+0000","last_clean":"2024-09-16T17:00:54.400267+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:54.400267+0000","last_undegraded":"2024-09-16T17:00:54.400267+0000","last_fullsized":"2024-09-16T17:00:54.400267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3325952,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.349901+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:00:48.349901+0000","last_peered":"2024-09-16T17:00:48.349901+0000","last_clean":"2024-09-16T17:00:48.349901+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:00:48.349901+0000","last_undegraded":"2024-09-16T17:00:48.349901+0000","last_fullsized":"2024-09-16T17:00:48.349901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":52609024,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6422,"num_write_kb":51376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875531776,"internally_reserved":0,"allocated":335962112,"data_stored":335962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6422,"ondisk_log_size":6422,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875527680,"internally_reserved":0,"allocated":335966208,"data_stored":335966208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61076,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236652,"statfs":{"total":53552873472,"available":53490331648,"internally_reserved":0,"allocated":62541824,"data_stored":62541824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":97572,"kb_used_data":97572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200156,"statfs":{"total":53552873472,"available":53452959744,"internally_reserved":0,"allocated":99913728,"data_stored":99913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":77324,"kb_used_data":77324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220404,"statfs":{"total":53552873472,"available":53473693696,"internally_reserved":0,"allocated":79179776,"data_stored":79179776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":89872,"kb_used_data":89872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207856,"statfs":{"total":53552873472,"available":53460844544,"internally_reserved":0,"allocated":92028928,"data_stored":92028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53473243136,"internally_reserved":0,"allocated":79630336,"data_stored":79630336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53473247232,"internally_reserved":0,"allocated":79626240,"data_stored":79626240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:12.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:12.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:12.259+0000 7f1b96711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:12.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:12.269+0000 7f1b96711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:12.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 84 16 8213 8197 0.762296 0.867188 0.183104 0.163844 2024-09-16T17:01:13.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 85 16 8275 8259 0.759026 0.484375 0.167956 0.164385 2024-09-16T17:01:14.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 86 16 8377 8361 0.759465 0.796875 0.319051 0.164476 2024-09-16T17:01:14.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:14.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:14.683+0000 7fd925c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:14.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:14.691+0000 7fd925c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:15.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 87 16 8470 8454 0.759086 0.726562 0.158649 0.164498 2024-09-16T17:01:16.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 88 16 8565 8549 0.758893 0.742188 0.0919923 0.164412 2024-09-16T17:01:16.452 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:16.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:01:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:16.583+0000 7f1b05351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:16.597+0000 7f1b05351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:17.088 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:17.189 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:01:17.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:01:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:17.235+0000 7f2abac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:17.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:17.246+0000 7f2abac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:17.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 89 16 8649 8633 0.757739 0.65625 0.207407 0.164694 2024-09-16T17:01:17.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:17.361+0000 7f79d426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:17.380+0000 7f79d426c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:18.190 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:01:18.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:01:18.319 INFO:tasks.radosbench.radosbench.0.smithi002.stdout: 90 15 8734 8719 0.756784 0.671875 0.234119 0.16481 2024-09-16T17:01:18.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:18.335+0000 7f105e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:18.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:18.346+0000 7f105e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:19.196 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:01:19.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total time run: 90.1898 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Total writes made: 8734 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Write size: 8192 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Object size: 65536 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Bandwidth (MB/sec): 0.756565 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Bandwidth: 0.100826 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max bandwidth (MB/sec): 0.976562 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min bandwidth (MB/sec): 0.46875 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average IOPS: 96 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev IOPS: 12.9057 2024-09-16T17:01:19.320 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max IOPS: 125 2024-09-16T17:01:19.321 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min IOPS: 60 2024-09-16T17:01:19.321 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Average Latency(s): 0.165033 2024-09-16T17:01:19.321 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Stddev Latency(s): 0.0926218 2024-09-16T17:01:19.321 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Max latency(s): 0.918164 2024-09-16T17:01:19.321 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Min latency(s): 0.0210356 2024-09-16T17:01:19.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:19.331+0000 7ff76ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:19.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:19.344+0000 7ff76ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:19.353 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T17:01:19.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:19.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:19.926+0000 7fd9b5b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:19.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:19.935+0000 7fd9b5b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:20.201 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:01:20.222 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:01:20.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:20.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:20.398+0000 7f0553d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:20.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:20.410+0000 7f0553d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:20.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:20.808 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:20.823 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":512,"stamp":"2024-09-16T17:01:20.530416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53199411,"num_objects":807,"num_object_clones":0,"num_object_copies":2421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6503,"num_write_kb":52484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6477,"ondisk_log_size":6477,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":325844,"kb_used_data":325844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208865068,"statfs":{"total":214211493888,"available":213877829632,"internally_reserved":0,"allocated":333664256,"data_stored":333664256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000741"},"pg_stats":[{"pgid":"10.7","version":"84'480","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.992720+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:53.992720+0000","last_peered":"2024-09-16T17:00:53.992720+0000","last_clean":"2024-09-16T17:00:53.992720+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:53.992720+0000","last_undegraded":"2024-09-16T17:00:53.992720+0000","last_fullsized":"2024-09-16T17:00:53.992720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"84'472","reported_seq":496,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.445963+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:51.445963+0000","last_peered":"2024-09-16T17:00:51.445963+0000","last_clean":"2024-09-16T17:00:51.445963+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:51.445963+0000","last_undegraded":"2024-09-16T17:00:51.445963+0000","last_fullsized":"2024-09-16T17:00:51.445963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"84'440","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.094605+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:54.094605+0000","last_peered":"2024-09-16T17:00:54.094605+0000","last_clean":"2024-09-16T17:00:54.094605+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:54.094605+0000","last_undegraded":"2024-09-16T17:00:54.094605+0000","last_fullsized":"2024-09-16T17:00:54.094605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.336390+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:54.336390+0000","last_peered":"2024-09-16T17:00:54.336390+0000","last_clean":"2024-09-16T17:00:54.336390+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:54.336390+0000","last_undegraded":"2024-09-16T17:00:54.336390+0000","last_fullsized":"2024-09-16T17:00:54.336390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.149310+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:54.149310+0000","last_peered":"2024-09-16T17:00:54.149310+0000","last_clean":"2024-09-16T17:00:54.149310+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:54.149310+0000","last_undegraded":"2024-09-16T17:00:54.149310+0000","last_fullsized":"2024-09-16T17:00:54.149310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"84'352","reported_seq":376,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.197680+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:52.197680+0000","last_peered":"2024-09-16T17:00:52.197680+0000","last_clean":"2024-09-16T17:00:52.197680+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:52.197680+0000","last_undegraded":"2024-09-16T17:00:52.197680+0000","last_fullsized":"2024-09-16T17:00:52.197680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"84'416","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.736558+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:53.736558+0000","last_peered":"2024-09-16T17:00:53.736558+0000","last_clean":"2024-09-16T17:00:53.736558+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:53.736558+0000","last_undegraded":"2024-09-16T17:00:53.736558+0000","last_fullsized":"2024-09-16T17:00:53.736558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"84'392","reported_seq":416,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.281207+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:53.281207+0000","last_peered":"2024-09-16T17:00:53.281207+0000","last_clean":"2024-09-16T17:00:53.281207+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:53.281207+0000","last_undegraded":"2024-09-16T17:00:53.281207+0000","last_fullsized":"2024-09-16T17:00:53.281207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"84'312","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.545161+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:51.545161+0000","last_peered":"2024-09-16T17:00:51.545161+0000","last_clean":"2024-09-16T17:00:51.545161+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:51.545161+0000","last_undegraded":"2024-09-16T17:00:51.545161+0000","last_fullsized":"2024-09-16T17:00:51.545161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.327112+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:00:48.327112+0000","last_peered":"2024-09-16T17:00:48.327112+0000","last_clean":"2024-09-16T17:00:48.327112+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:00:48.327112+0000","last_undegraded":"2024-09-16T17:00:48.327112+0000","last_fullsized":"2024-09-16T17:00:48.327112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.347361+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:00:48.347361+0000","last_peered":"2024-09-16T17:00:48.347361+0000","last_clean":"2024-09-16T17:00:48.347361+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:00:48.347361+0000","last_undegraded":"2024-09-16T17:00:48.347361+0000","last_fullsized":"2024-09-16T17:00:48.347361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.209093+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:54.209093+0000","last_peered":"2024-09-16T17:00:54.209093+0000","last_clean":"2024-09-16T17:00:54.209093+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:54.209093+0000","last_undegraded":"2024-09-16T17:00:54.209093+0000","last_fullsized":"2024-09-16T17:00:54.209093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.453026+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:00:48.453026+0000","last_peered":"2024-09-16T17:00:48.453026+0000","last_clean":"2024-09-16T17:00:48.453026+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:00:48.453026+0000","last_undegraded":"2024-09-16T17:00:48.453026+0000","last_fullsized":"2024-09-16T17:00:48.453026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"84'304","reported_seq":328,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.356417+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:53.356417+0000","last_peered":"2024-09-16T17:00:53.356417+0000","last_clean":"2024-09-16T17:00:53.356417+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:53.356417+0000","last_undegraded":"2024-09-16T17:00:53.356417+0000","last_fullsized":"2024-09-16T17:00:53.356417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.342511+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:00:48.342511+0000","last_peered":"2024-09-16T17:00:48.342511+0000","last_clean":"2024-09-16T17:00:48.342511+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:00:48.342511+0000","last_undegraded":"2024-09-16T17:00:48.342511+0000","last_fullsized":"2024-09-16T17:00:48.342511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"84'432","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.194008+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:53.194008+0000","last_peered":"2024-09-16T17:00:53.194008+0000","last_clean":"2024-09-16T17:00:53.194008+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:53.194008+0000","last_undegraded":"2024-09-16T17:00:53.194008+0000","last_fullsized":"2024-09-16T17:00:53.194008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":219,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.437366+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:00:48.437366+0000","last_peered":"2024-09-16T17:00:48.437366+0000","last_clean":"2024-09-16T17:00:48.437366+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:00:48.437366+0000","last_undegraded":"2024-09-16T17:00:48.437366+0000","last_fullsized":"2024-09-16T17:00:48.437366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.960238+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:51.960238+0000","last_peered":"2024-09-16T17:00:51.960238+0000","last_clean":"2024-09-16T17:00:51.960238+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:51.960238+0000","last_undegraded":"2024-09-16T17:00:51.960238+0000","last_fullsized":"2024-09-16T17:00:51.960238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.359250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:00:48.359250+0000","last_peered":"2024-09-16T17:00:48.359250+0000","last_clean":"2024-09-16T17:00:48.359250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:00:48.359250+0000","last_undegraded":"2024-09-16T17:00:48.359250+0000","last_fullsized":"2024-09-16T17:00:48.359250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"84'336","reported_seq":360,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.447421+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:52.447421+0000","last_peered":"2024-09-16T17:00:52.447421+0000","last_clean":"2024-09-16T17:00:52.447421+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:52.447421+0000","last_undegraded":"2024-09-16T17:00:52.447421+0000","last_fullsized":"2024-09-16T17:00:52.447421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.334233+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:00:48.334233+0000","last_peered":"2024-09-16T17:00:48.334233+0000","last_clean":"2024-09-16T17:00:48.334233+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:00:48.334233+0000","last_undegraded":"2024-09-16T17:00:48.334233+0000","last_fullsized":"2024-09-16T17:00:48.334233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.267466+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:54.267466+0000","last_peered":"2024-09-16T17:00:54.267466+0000","last_clean":"2024-09-16T17:00:54.267466+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:54.267466+0000","last_undegraded":"2024-09-16T17:00:54.267466+0000","last_fullsized":"2024-09-16T17:00:54.267466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.357928+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:00:48.357928+0000","last_peered":"2024-09-16T17:00:48.357928+0000","last_clean":"2024-09-16T17:00:48.357928+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:00:48.357928+0000","last_undegraded":"2024-09-16T17:00:48.357928+0000","last_fullsized":"2024-09-16T17:00:48.357928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"84'406","reported_seq":430,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.400267+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:54.400267+0000","last_peered":"2024-09-16T17:00:54.400267+0000","last_clean":"2024-09-16T17:00:54.400267+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:54.400267+0000","last_undegraded":"2024-09-16T17:00:54.400267+0000","last_fullsized":"2024-09-16T17:00:54.400267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3325952,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.349901+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:00:48.349901+0000","last_peered":"2024-09-16T17:00:48.349901+0000","last_clean":"2024-09-16T17:00:48.349901+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:00:48.349901+0000","last_undegraded":"2024-09-16T17:00:48.349901+0000","last_fullsized":"2024-09-16T17:00:48.349901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":52609024,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6422,"num_write_kb":51376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875531776,"internally_reserved":0,"allocated":335962112,"data_stored":335962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6422,"ondisk_log_size":6422,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875527680,"internally_reserved":0,"allocated":335966208,"data_stored":335966208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61076,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236652,"statfs":{"total":53552873472,"available":53490331648,"internally_reserved":0,"allocated":62541824,"data_stored":62541824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":97572,"kb_used_data":97572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200156,"statfs":{"total":53552873472,"available":53452959744,"internally_reserved":0,"allocated":99913728,"data_stored":99913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":77324,"kb_used_data":77324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220404,"statfs":{"total":53552873472,"available":53473693696,"internally_reserved":0,"allocated":79179776,"data_stored":79179776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":89872,"kb_used_data":89872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207856,"statfs":{"total":53552873472,"available":53460844544,"internally_reserved":0,"allocated":92028928,"data_stored":92028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53473243136,"internally_reserved":0,"allocated":79630336,"data_stored":79630336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53473247232,"internally_reserved":0,"allocated":79626240,"data_stored":79626240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:20.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:20.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:20.975+0000 7f2948b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:20.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:20.992+0000 7f2948b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:21.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:21.335 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":512,"stamp":"2024-09-16T17:01:20.530416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":53199411,"num_objects":807,"num_object_clones":0,"num_object_copies":2421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6503,"num_write_kb":52484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6477,"ondisk_log_size":6477,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":325844,"kb_used_data":325844,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208865068,"statfs":{"total":214211493888,"available":213877829632,"internally_reserved":0,"allocated":333664256,"data_stored":333664256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000741"},"pg_stats":[{"pgid":"10.7","version":"84'480","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.992720+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:00:53.992720+0000","last_peered":"2024-09-16T17:00:53.992720+0000","last_clean":"2024-09-16T17:00:53.992720+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:00:53.992720+0000","last_undegraded":"2024-09-16T17:00:53.992720+0000","last_fullsized":"2024-09-16T17:00:53.992720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"84'472","reported_seq":496,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.445963+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:00:51.445963+0000","last_peered":"2024-09-16T17:00:51.445963+0000","last_clean":"2024-09-16T17:00:51.445963+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:00:51.445963+0000","last_undegraded":"2024-09-16T17:00:51.445963+0000","last_fullsized":"2024-09-16T17:00:51.445963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"84'440","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.094605+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:00:54.094605+0000","last_peered":"2024-09-16T17:00:54.094605+0000","last_clean":"2024-09-16T17:00:54.094605+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:00:54.094605+0000","last_undegraded":"2024-09-16T17:00:54.094605+0000","last_fullsized":"2024-09-16T17:00:54.094605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.336390+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:00:54.336390+0000","last_peered":"2024-09-16T17:00:54.336390+0000","last_clean":"2024-09-16T17:00:54.336390+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:00:54.336390+0000","last_undegraded":"2024-09-16T17:00:54.336390+0000","last_fullsized":"2024-09-16T17:00:54.336390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.149310+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:00:54.149310+0000","last_peered":"2024-09-16T17:00:54.149310+0000","last_clean":"2024-09-16T17:00:54.149310+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:00:54.149310+0000","last_undegraded":"2024-09-16T17:00:54.149310+0000","last_fullsized":"2024-09-16T17:00:54.149310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"84'352","reported_seq":376,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.197680+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:00:52.197680+0000","last_peered":"2024-09-16T17:00:52.197680+0000","last_clean":"2024-09-16T17:00:52.197680+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:00:52.197680+0000","last_undegraded":"2024-09-16T17:00:52.197680+0000","last_fullsized":"2024-09-16T17:00:52.197680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"84'416","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.736558+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:00:53.736558+0000","last_peered":"2024-09-16T17:00:53.736558+0000","last_clean":"2024-09-16T17:00:53.736558+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:00:53.736558+0000","last_undegraded":"2024-09-16T17:00:53.736558+0000","last_fullsized":"2024-09-16T17:00:53.736558+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"84'392","reported_seq":416,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.281207+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:00:53.281207+0000","last_peered":"2024-09-16T17:00:53.281207+0000","last_clean":"2024-09-16T17:00:53.281207+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:00:53.281207+0000","last_undegraded":"2024-09-16T17:00:53.281207+0000","last_fullsized":"2024-09-16T17:00:53.281207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"84'312","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.545161+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:00:51.545161+0000","last_peered":"2024-09-16T17:00:51.545161+0000","last_clean":"2024-09-16T17:00:51.545161+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:00:51.545161+0000","last_undegraded":"2024-09-16T17:00:51.545161+0000","last_fullsized":"2024-09-16T17:00:51.545161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.327112+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:00:48.327112+0000","last_peered":"2024-09-16T17:00:48.327112+0000","last_clean":"2024-09-16T17:00:48.327112+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:00:48.327112+0000","last_undegraded":"2024-09-16T17:00:48.327112+0000","last_fullsized":"2024-09-16T17:00:48.327112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":218,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.347361+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:00:48.347361+0000","last_peered":"2024-09-16T17:00:48.347361+0000","last_clean":"2024-09-16T17:00:48.347361+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:00:48.347361+0000","last_undegraded":"2024-09-16T17:00:48.347361+0000","last_fullsized":"2024-09-16T17:00:48.347361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.209093+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:00:54.209093+0000","last_peered":"2024-09-16T17:00:54.209093+0000","last_clean":"2024-09-16T17:00:54.209093+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:00:54.209093+0000","last_undegraded":"2024-09-16T17:00:54.209093+0000","last_fullsized":"2024-09-16T17:00:54.209093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.453026+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:00:48.453026+0000","last_peered":"2024-09-16T17:00:48.453026+0000","last_clean":"2024-09-16T17:00:48.453026+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:00:48.453026+0000","last_undegraded":"2024-09-16T17:00:48.453026+0000","last_fullsized":"2024-09-16T17:00:48.453026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"84'304","reported_seq":328,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.356417+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:00:53.356417+0000","last_peered":"2024-09-16T17:00:53.356417+0000","last_clean":"2024-09-16T17:00:53.356417+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:00:53.356417+0000","last_undegraded":"2024-09-16T17:00:53.356417+0000","last_fullsized":"2024-09-16T17:00:53.356417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.342511+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:00:48.342511+0000","last_peered":"2024-09-16T17:00:48.342511+0000","last_clean":"2024-09-16T17:00:48.342511+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:00:48.342511+0000","last_undegraded":"2024-09-16T17:00:48.342511+0000","last_fullsized":"2024-09-16T17:00:48.342511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"84'432","reported_seq":456,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:53.194008+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:00:53.194008+0000","last_peered":"2024-09-16T17:00:53.194008+0000","last_clean":"2024-09-16T17:00:53.194008+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:00:53.194008+0000","last_undegraded":"2024-09-16T17:00:53.194008+0000","last_fullsized":"2024-09-16T17:00:53.194008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":219,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.437366+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:00:48.437366+0000","last_peered":"2024-09-16T17:00:48.437366+0000","last_clean":"2024-09-16T17:00:48.437366+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:00:48.437366+0000","last_undegraded":"2024-09-16T17:00:48.437366+0000","last_fullsized":"2024-09-16T17:00:48.437366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"84'488","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:51.960238+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:00:51.960238+0000","last_peered":"2024-09-16T17:00:51.960238+0000","last_clean":"2024-09-16T17:00:51.960238+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:00:51.960238+0000","last_undegraded":"2024-09-16T17:00:51.960238+0000","last_fullsized":"2024-09-16T17:00:51.960238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.359250+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:00:48.359250+0000","last_peered":"2024-09-16T17:00:48.359250+0000","last_clean":"2024-09-16T17:00:48.359250+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:00:48.359250+0000","last_undegraded":"2024-09-16T17:00:48.359250+0000","last_fullsized":"2024-09-16T17:00:48.359250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"84'336","reported_seq":360,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:52.447421+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:00:52.447421+0000","last_peered":"2024-09-16T17:00:52.447421+0000","last_clean":"2024-09-16T17:00:52.447421+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:00:52.447421+0000","last_undegraded":"2024-09-16T17:00:52.447421+0000","last_fullsized":"2024-09-16T17:00:52.447421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.334233+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:00:48.334233+0000","last_peered":"2024-09-16T17:00:48.334233+0000","last_clean":"2024-09-16T17:00:48.334233+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:00:48.334233+0000","last_undegraded":"2024-09-16T17:00:48.334233+0000","last_fullsized":"2024-09-16T17:00:48.334233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"84'368","reported_seq":392,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.267466+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:00:54.267466+0000","last_peered":"2024-09-16T17:00:54.267466+0000","last_clean":"2024-09-16T17:00:54.267466+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:00:54.267466+0000","last_undegraded":"2024-09-16T17:00:54.267466+0000","last_fullsized":"2024-09-16T17:00:54.267466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.357928+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:00:48.357928+0000","last_peered":"2024-09-16T17:00:48.357928+0000","last_clean":"2024-09-16T17:00:48.357928+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:00:48.357928+0000","last_undegraded":"2024-09-16T17:00:48.357928+0000","last_fullsized":"2024-09-16T17:00:48.357928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"84'406","reported_seq":430,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:54.400267+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:00:54.400267+0000","last_peered":"2024-09-16T17:00:54.400267+0000","last_clean":"2024-09-16T17:00:54.400267+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:00:54.400267+0000","last_undegraded":"2024-09-16T17:00:54.400267+0000","last_fullsized":"2024-09-16T17:00:54.400267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3325952,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T17:00:48.349901+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:00:48.349901+0000","last_peered":"2024-09-16T17:00:48.349901+0000","last_clean":"2024-09-16T17:00:48.349901+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:00:48.349901+0000","last_undegraded":"2024-09-16T17:00:48.349901+0000","last_fullsized":"2024-09-16T17:00:48.349901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":52609024,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6422,"num_write_kb":51376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875531776,"internally_reserved":0,"allocated":335962112,"data_stored":335962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6422,"ondisk_log_size":6422,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213875527680,"internally_reserved":0,"allocated":335966208,"data_stored":335966208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":61076,"kb_used_data":61076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52236652,"statfs":{"total":53552873472,"available":53490331648,"internally_reserved":0,"allocated":62541824,"data_stored":62541824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":97572,"kb_used_data":97572,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52200156,"statfs":{"total":53552873472,"available":53452959744,"internally_reserved":0,"allocated":99913728,"data_stored":99913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":77324,"kb_used_data":77324,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220404,"statfs":{"total":53552873472,"available":53473693696,"internally_reserved":0,"allocated":79179776,"data_stored":79179776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706504,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":89872,"kb_used_data":89872,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52207856,"statfs":{"total":53552873472,"available":53460844544,"internally_reserved":0,"allocated":92028928,"data_stored":92028928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53489582080,"internally_reserved":0,"allocated":63291392,"data_stored":63291392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53473243136,"internally_reserved":0,"allocated":79630336,"data_stored":79630336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53460316160,"internally_reserved":0,"allocated":92557312,"data_stored":92557312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53473247232,"internally_reserved":0,"allocated":79626240,"data_stored":79626240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53452394496,"internally_reserved":0,"allocated":100478976,"data_stored":100478976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53489573888,"internally_reserved":0,"allocated":63299584,"data_stored":63299584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:21.336 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:01:21.336 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:21.337 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T17:01:21.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T17:01:21.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:21.490+0000 7f620acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:21.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:21.504+0000 7f620acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:01:21.608 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:01:21.609 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:01:21.609 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:01:21.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:21.612 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:21.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T17:01:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:21.745+0000 7fc9c9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:21.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:21.762+0000 7fc9c9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:01:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:01:21.789 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:01:21.793 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:21.793 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:21.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T17:01:21.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:21.918+0000 7f59b3b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:21.976 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:21.930+0000 7f59b3b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:01:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:01:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:01:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:01:21.976 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:01:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:01:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:01:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:01:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:01:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:01:21.977 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:01:21.977 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:21.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T17:01:22.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:22.119+0000 7ff9a0c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:22.134+0000 7ff9a0c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:no valid command found; 10 closest matches: 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:bench [] [] [] [] 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:config get 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:config help 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:config set ... 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:config show 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:deep_scrub 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_ops 2024-09-16T17:01:22.175 INFO:teuthology.orchestra.run.smithi002.stderr:dump_historic_slow_ops 2024-09-16T17:01:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:dump_metrics [] 2024-09-16T17:01:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:dump_ops_in_flight 2024-09-16T17:01:22.176 INFO:teuthology.orchestra.run.smithi002.stderr:Error EINVAL: invalid command 2024-09-16T17:01:22.179 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T17:01:22.179 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T17:01:22.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:22.448+0000 7f4b44f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:22.456+0000 7f4b44f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:24.969+0000 7f9e91f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:24.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:24.982+0000 7f9e91f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:27.180 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:27.180 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:27.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:27.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:27.337+0000 7f559d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:27.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:27.349+0000 7f559d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:27.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:27.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:27.556+0000 7f152d44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:27.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:27.565+0000 7f152d44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:27.749 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:27.749 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:27.774 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2024-09-16T17:01:26.531675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38715979,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9326,"num_write_kb":70981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9300,"ondisk_log_size":9300,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":267380,"kb_used_data":267380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208923532,"statfs":{"total":214211493888,"available":213937696768,"internally_reserved":0,"allocated":273797120,"data_stored":273797120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14483432,"num_objects":-220,"num_object_clones":0,"num_object_copies":-660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2823,"num_write_kb":18497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001616"},"pg_stats":[{"pgid":"10.7","version":"88'675","reported_seq":711,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.262527+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:01:24.262527+0000","last_peered":"2024-09-16T17:01:24.262527+0000","last_clean":"2024-09-16T17:01:24.262527+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:01:24.262527+0000","last_undegraded":"2024-09-16T17:01:24.262527+0000","last_fullsized":"2024-09-16T17:01:24.262527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"88'623","reported_seq":659,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.323367+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:01:24.323367+0000","last_peered":"2024-09-16T17:01:24.323367+0000","last_clean":"2024-09-16T17:01:24.323367+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:01:24.323367+0000","last_undegraded":"2024-09-16T17:01:24.323367+0000","last_fullsized":"2024-09-16T17:01:24.323367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"88'545","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.122254+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:01:24.122254+0000","last_peered":"2024-09-16T17:01:24.122254+0000","last_clean":"2024-09-16T17:01:24.122254+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:01:24.122254+0000","last_undegraded":"2024-09-16T17:01:24.122254+0000","last_fullsized":"2024-09-16T17:01:24.122254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"88'574","reported_seq":610,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.333412+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:01:24.333412+0000","last_peered":"2024-09-16T17:01:24.333412+0000","last_clean":"2024-09-16T17:01:24.333412+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:01:24.333412+0000","last_undegraded":"2024-09-16T17:01:24.333412+0000","last_fullsized":"2024-09-16T17:01:24.333412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"88'642","reported_seq":678,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.061541+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:01:24.061541+0000","last_peered":"2024-09-16T17:01:24.061541+0000","last_clean":"2024-09-16T17:01:24.061541+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:01:24.061541+0000","last_undegraded":"2024-09-16T17:01:24.061541+0000","last_fullsized":"2024-09-16T17:01:24.061541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"88'539","reported_seq":575,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.610803+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:01:23.610803+0000","last_peered":"2024-09-16T17:01:23.610803+0000","last_clean":"2024-09-16T17:01:23.610803+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:01:23.610803+0000","last_undegraded":"2024-09-16T17:01:23.610803+0000","last_fullsized":"2024-09-16T17:01:23.610803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"88'587","reported_seq":623,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.984814+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:01:23.984814+0000","last_peered":"2024-09-16T17:01:23.984814+0000","last_clean":"2024-09-16T17:01:23.984814+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:01:23.984814+0000","last_undegraded":"2024-09-16T17:01:23.984814+0000","last_fullsized":"2024-09-16T17:01:23.984814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"88'576","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.029676+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:01:24.029676+0000","last_peered":"2024-09-16T17:01:24.029676+0000","last_clean":"2024-09-16T17:01:24.029676+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:01:24.029676+0000","last_undegraded":"2024-09-16T17:01:24.029676+0000","last_fullsized":"2024-09-16T17:01:24.029676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"88'469","reported_seq":505,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.329525+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:01:24.329525+0000","last_peered":"2024-09-16T17:01:24.329525+0000","last_clean":"2024-09-16T17:01:24.329525+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:01:24.329525+0000","last_undegraded":"2024-09-16T17:01:24.329525+0000","last_fullsized":"2024-09-16T17:01:24.329525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":469,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.233446+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:20.233446+0000","last_peered":"2024-09-16T17:01:20.233446+0000","last_clean":"2024-09-16T17:01:20.233446+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:20.233446+0000","last_undegraded":"2024-09-16T17:01:20.233446+0000","last_fullsized":"2024-09-16T17:01:20.233446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":230,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.255305+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:20.255305+0000","last_peered":"2024-09-16T17:01:20.255305+0000","last_clean":"2024-09-16T17:01:20.255305+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:20.255305+0000","last_undegraded":"2024-09-16T17:01:20.255305+0000","last_fullsized":"2024-09-16T17:01:20.255305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"88'559","reported_seq":595,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.346161+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:01:24.346161+0000","last_peered":"2024-09-16T17:01:24.346161+0000","last_clean":"2024-09-16T17:01:24.346161+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:01:24.346161+0000","last_undegraded":"2024-09-16T17:01:24.346161+0000","last_fullsized":"2024-09-16T17:01:24.346161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.331489+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:01:20.331489+0000","last_peered":"2024-09-16T17:01:20.331489+0000","last_clean":"2024-09-16T17:01:20.331489+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:20.331489+0000","last_undegraded":"2024-09-16T17:01:20.331489+0000","last_fullsized":"2024-09-16T17:01:20.331489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"88'476","reported_seq":512,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.623585+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:01:23.623585+0000","last_peered":"2024-09-16T17:01:23.623585+0000","last_clean":"2024-09-16T17:01:23.623585+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:01:23.623585+0000","last_undegraded":"2024-09-16T17:01:23.623585+0000","last_fullsized":"2024-09-16T17:01:23.623585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.235127+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:20.235127+0000","last_peered":"2024-09-16T17:01:20.235127+0000","last_clean":"2024-09-16T17:01:20.235127+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:20.235127+0000","last_undegraded":"2024-09-16T17:01:20.235127+0000","last_fullsized":"2024-09-16T17:01:20.235127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"88'633","reported_seq":669,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.356109+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:01:24.356109+0000","last_peered":"2024-09-16T17:01:24.356109+0000","last_clean":"2024-09-16T17:01:24.356109+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:01:24.356109+0000","last_undegraded":"2024-09-16T17:01:24.356109+0000","last_fullsized":"2024-09-16T17:01:24.356109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":633,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":231,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.329200+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:01:20.329200+0000","last_peered":"2024-09-16T17:01:20.329200+0000","last_clean":"2024-09-16T17:01:20.329200+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:20.329200+0000","last_undegraded":"2024-09-16T17:01:20.329200+0000","last_fullsized":"2024-09-16T17:01:20.329200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"88'681","reported_seq":717,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.990972+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:01:23.990972+0000","last_peered":"2024-09-16T17:01:23.990972+0000","last_clean":"2024-09-16T17:01:23.990972+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:01:23.990972+0000","last_undegraded":"2024-09-16T17:01:23.990972+0000","last_fullsized":"2024-09-16T17:01:23.990972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.349005+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:20.349005+0000","last_peered":"2024-09-16T17:01:20.349005+0000","last_clean":"2024-09-16T17:01:20.349005+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:20.349005+0000","last_undegraded":"2024-09-16T17:01:20.349005+0000","last_fullsized":"2024-09-16T17:01:20.349005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"88'522","reported_seq":559,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.141207+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:01:24.141207+0000","last_peered":"2024-09-16T17:01:24.141207+0000","last_clean":"2024-09-16T17:01:24.141207+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:01:24.141207+0000","last_undegraded":"2024-09-16T17:01:24.141207+0000","last_fullsized":"2024-09-16T17:01:24.141207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2277400,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":522,"num_write_kb":3953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.238593+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:20.238593+0000","last_peered":"2024-09-16T17:01:20.238593+0000","last_clean":"2024-09-16T17:01:20.238593+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:20.238593+0000","last_undegraded":"2024-09-16T17:01:20.238593+0000","last_fullsized":"2024-09-16T17:01:20.238593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"88'516","reported_seq":552,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.849271+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:01:23.849271+0000","last_peered":"2024-09-16T17:01:23.849271+0000","last_clean":"2024-09-16T17:01:23.849271+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:01:23.849271+0000","last_undegraded":"2024-09-16T17:01:23.849271+0000","last_fullsized":"2024-09-16T17:01:23.849271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.344814+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:20.344814+0000","last_peered":"2024-09-16T17:01:20.344814+0000","last_clean":"2024-09-16T17:01:20.344814+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:20.344814+0000","last_undegraded":"2024-09-16T17:01:20.344814+0000","last_fullsized":"2024-09-16T17:01:20.344814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"88'628","reported_seq":664,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.223323+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:01:24.223323+0000","last_peered":"2024-09-16T17:01:24.223323+0000","last_clean":"2024-09-16T17:01:24.223323+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:01:24.223323+0000","last_undegraded":"2024-09-16T17:01:24.223323+0000","last_fullsized":"2024-09-16T17:01:24.223323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.243946+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:20.243946+0000","last_peered":"2024-09-16T17:01:20.243946+0000","last_clean":"2024-09-16T17:01:20.243946+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:20.243946+0000","last_undegraded":"2024-09-16T17:01:20.243946+0000","last_fullsized":"2024-09-16T17:01:20.243946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":38125592,"num_objects":583,"num_object_clones":0,"num_object_copies":1749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9245,"num_write_kb":69873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213955670016,"internally_reserved":0,"allocated":255823872,"data_stored":255823872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9245,"ondisk_log_size":9245,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213955538944,"internally_reserved":0,"allocated":255954944,"data_stored":255954944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":51760,"kb_used_data":51760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52245968,"statfs":{"total":53552873472,"available":53499871232,"internally_reserved":0,"allocated":53002240,"data_stored":53002240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76908,"kb_used_data":76908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220820,"statfs":{"total":53552873472,"available":53474119680,"internally_reserved":0,"allocated":78753792,"data_stored":78753792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65804,"kb_used_data":65804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231924,"statfs":{"total":53552873472,"available":53485490176,"internally_reserved":0,"allocated":67383296,"data_stored":67383296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":72908,"kb_used_data":72908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52224820,"statfs":{"total":53552873472,"available":53478215680,"internally_reserved":0,"allocated":74657792,"data_stored":74657792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481529344,"internally_reserved":0,"allocated":71344128,"data_stored":71344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53490618368,"internally_reserved":0,"allocated":62255104,"data_stored":62255104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53478084608,"internally_reserved":0,"allocated":74788864,"data_stored":74788864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53481660416,"internally_reserved":0,"allocated":71213056,"data_stored":71213056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53490618368,"internally_reserved":0,"allocated":62255104,"data_stored":62255104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53478084608,"internally_reserved":0,"allocated":74788864,"data_stored":74788864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:29.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T17:01:30.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:30.030+0000 7f564a111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:30.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:30.041+0000 7f564a111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:30.635 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Removed 1092 objects 2024-09-16T17:01:30.635 INFO:tasks.radosbench.radosbench.0.smithi002.stdout:Clean up completed and total clean up time :11.2811 2024-09-16T17:01:31.967 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_7 2024-09-16T17:01:31.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2024-09-16T17:01:32.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:32.090+0000 7f4932d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:32.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:32.104+0000 7f4932d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:32.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T17:01:32.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:32.461+0000 7f280c6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:32.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:32.467+0000 7f280c6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:32.776 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T17:01:32.776 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T17:01:32.777 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:32.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:32.888+0000 7fb40e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:32.896+0000 7fb40e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:33.092 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:33.093 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:33.105 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-09-16T17:01:32.532803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38715979,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":9326,"num_write_kb":70981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9300,"ondisk_log_size":9300,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":267380,"kb_used_data":267380,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208923532,"statfs":{"total":214211493888,"available":213937696768,"internally_reserved":0,"allocated":273797120,"data_stored":273797120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14483432,"num_objects":-220,"num_object_clones":0,"num_object_copies":-660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2823,"num_write_kb":18497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002387"},"pg_stats":[{"pgid":"10.7","version":"88'675","reported_seq":711,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.262527+0000","last_change":"2024-09-16T16:59:47.374463+0000","last_active":"2024-09-16T17:01:24.262527+0000","last_peered":"2024-09-16T17:01:24.262527+0000","last_clean":"2024-09-16T17:01:24.262527+0000","last_became_active":"2024-09-16T16:59:47.365950+0000","last_became_peered":"2024-09-16T16:59:47.365950+0000","last_unstale":"2024-09-16T17:01:24.262527+0000","last_undegraded":"2024-09-16T17:01:24.262527+0000","last_fullsized":"2024-09-16T17:01:24.262527+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"88'623","reported_seq":659,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.323367+0000","last_change":"2024-09-16T16:59:47.565617+0000","last_active":"2024-09-16T17:01:24.323367+0000","last_peered":"2024-09-16T17:01:24.323367+0000","last_clean":"2024-09-16T17:01:24.323367+0000","last_became_active":"2024-09-16T16:59:47.554701+0000","last_became_peered":"2024-09-16T16:59:47.554701+0000","last_unstale":"2024-09-16T17:01:24.323367+0000","last_undegraded":"2024-09-16T17:01:24.323367+0000","last_fullsized":"2024-09-16T17:01:24.323367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"88'545","reported_seq":581,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.122254+0000","last_change":"2024-09-16T16:59:47.445369+0000","last_active":"2024-09-16T17:01:24.122254+0000","last_peered":"2024-09-16T17:01:24.122254+0000","last_clean":"2024-09-16T17:01:24.122254+0000","last_became_active":"2024-09-16T16:59:47.401040+0000","last_became_peered":"2024-09-16T16:59:47.401040+0000","last_unstale":"2024-09-16T17:01:24.122254+0000","last_undegraded":"2024-09-16T17:01:24.122254+0000","last_fullsized":"2024-09-16T17:01:24.122254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"88'574","reported_seq":610,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.333412+0000","last_change":"2024-09-16T16:59:47.400954+0000","last_active":"2024-09-16T17:01:24.333412+0000","last_peered":"2024-09-16T17:01:24.333412+0000","last_clean":"2024-09-16T17:01:24.333412+0000","last_became_active":"2024-09-16T16:59:47.383356+0000","last_became_peered":"2024-09-16T16:59:47.383356+0000","last_unstale":"2024-09-16T17:01:24.333412+0000","last_undegraded":"2024-09-16T17:01:24.333412+0000","last_fullsized":"2024-09-16T17:01:24.333412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"88'642","reported_seq":678,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.061541+0000","last_change":"2024-09-16T16:59:47.500843+0000","last_active":"2024-09-16T17:01:24.061541+0000","last_peered":"2024-09-16T17:01:24.061541+0000","last_clean":"2024-09-16T17:01:24.061541+0000","last_became_active":"2024-09-16T16:59:47.489570+0000","last_became_peered":"2024-09-16T16:59:47.489570+0000","last_unstale":"2024-09-16T17:01:24.061541+0000","last_undegraded":"2024-09-16T17:01:24.061541+0000","last_fullsized":"2024-09-16T17:01:24.061541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":642,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"88'539","reported_seq":575,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.610803+0000","last_change":"2024-09-16T16:59:47.491969+0000","last_active":"2024-09-16T17:01:23.610803+0000","last_peered":"2024-09-16T17:01:23.610803+0000","last_clean":"2024-09-16T17:01:23.610803+0000","last_became_active":"2024-09-16T16:59:47.484730+0000","last_became_peered":"2024-09-16T16:59:47.484730+0000","last_unstale":"2024-09-16T17:01:23.610803+0000","last_undegraded":"2024-09-16T17:01:23.610803+0000","last_fullsized":"2024-09-16T17:01:23.610803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"88'587","reported_seq":623,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.984814+0000","last_change":"2024-09-16T16:59:47.389387+0000","last_active":"2024-09-16T17:01:23.984814+0000","last_peered":"2024-09-16T17:01:23.984814+0000","last_clean":"2024-09-16T17:01:23.984814+0000","last_became_active":"2024-09-16T16:59:47.381089+0000","last_became_peered":"2024-09-16T16:59:47.381089+0000","last_unstale":"2024-09-16T17:01:23.984814+0000","last_undegraded":"2024-09-16T17:01:23.984814+0000","last_fullsized":"2024-09-16T17:01:23.984814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":587,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"88'576","reported_seq":612,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.029676+0000","last_change":"2024-09-16T16:59:47.464251+0000","last_active":"2024-09-16T17:01:24.029676+0000","last_peered":"2024-09-16T17:01:24.029676+0000","last_clean":"2024-09-16T17:01:24.029676+0000","last_became_active":"2024-09-16T16:59:47.453680+0000","last_became_peered":"2024-09-16T16:59:47.453680+0000","last_unstale":"2024-09-16T17:01:24.029676+0000","last_undegraded":"2024-09-16T17:01:24.029676+0000","last_fullsized":"2024-09-16T17:01:24.029676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"88'469","reported_seq":505,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.329525+0000","last_change":"2024-09-16T16:59:47.365414+0000","last_active":"2024-09-16T17:01:24.329525+0000","last_peered":"2024-09-16T17:01:24.329525+0000","last_clean":"2024-09-16T17:01:24.329525+0000","last_became_active":"2024-09-16T16:59:47.326209+0000","last_became_peered":"2024-09-16T16:59:47.326209+0000","last_unstale":"2024-09-16T17:01:24.329525+0000","last_undegraded":"2024-09-16T17:01:24.329525+0000","last_fullsized":"2024-09-16T17:01:24.329525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":469,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":304,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.233446+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:20.233446+0000","last_peered":"2024-09-16T17:01:20.233446+0000","last_clean":"2024-09-16T17:01:20.233446+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:20.233446+0000","last_undegraded":"2024-09-16T17:01:20.233446+0000","last_fullsized":"2024-09-16T17:01:20.233446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":230,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.255305+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:20.255305+0000","last_peered":"2024-09-16T17:01:20.255305+0000","last_clean":"2024-09-16T17:01:20.255305+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:20.255305+0000","last_undegraded":"2024-09-16T17:01:20.255305+0000","last_fullsized":"2024-09-16T17:01:20.255305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"88'559","reported_seq":595,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.346161+0000","last_change":"2024-09-16T16:59:47.415728+0000","last_active":"2024-09-16T17:01:24.346161+0000","last_peered":"2024-09-16T17:01:24.346161+0000","last_clean":"2024-09-16T17:01:24.346161+0000","last_became_active":"2024-09-16T16:59:47.390923+0000","last_became_peered":"2024-09-16T16:59:47.390923+0000","last_unstale":"2024-09-16T17:01:24.346161+0000","last_undegraded":"2024-09-16T17:01:24.346161+0000","last_fullsized":"2024-09-16T17:01:24.346161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.331489+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:01:20.331489+0000","last_peered":"2024-09-16T17:01:20.331489+0000","last_clean":"2024-09-16T17:01:20.331489+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:20.331489+0000","last_undegraded":"2024-09-16T17:01:20.331489+0000","last_fullsized":"2024-09-16T17:01:20.331489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"88'476","reported_seq":512,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.623585+0000","last_change":"2024-09-16T16:59:47.429842+0000","last_active":"2024-09-16T17:01:23.623585+0000","last_peered":"2024-09-16T17:01:23.623585+0000","last_clean":"2024-09-16T17:01:23.623585+0000","last_became_active":"2024-09-16T16:59:47.408032+0000","last_became_peered":"2024-09-16T16:59:47.408032+0000","last_unstale":"2024-09-16T17:01:23.623585+0000","last_undegraded":"2024-09-16T17:01:23.623585+0000","last_fullsized":"2024-09-16T17:01:23.623585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.235127+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:20.235127+0000","last_peered":"2024-09-16T17:01:20.235127+0000","last_clean":"2024-09-16T17:01:20.235127+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:20.235127+0000","last_undegraded":"2024-09-16T17:01:20.235127+0000","last_fullsized":"2024-09-16T17:01:20.235127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"88'633","reported_seq":669,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.356109+0000","last_change":"2024-09-16T16:59:47.525354+0000","last_active":"2024-09-16T17:01:24.356109+0000","last_peered":"2024-09-16T17:01:24.356109+0000","last_clean":"2024-09-16T17:01:24.356109+0000","last_became_active":"2024-09-16T16:59:47.505682+0000","last_became_peered":"2024-09-16T16:59:47.505682+0000","last_unstale":"2024-09-16T17:01:24.356109+0000","last_undegraded":"2024-09-16T17:01:24.356109+0000","last_fullsized":"2024-09-16T17:01:24.356109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":633,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":231,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.329200+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:01:20.329200+0000","last_peered":"2024-09-16T17:01:20.329200+0000","last_clean":"2024-09-16T17:01:20.329200+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:20.329200+0000","last_undegraded":"2024-09-16T17:01:20.329200+0000","last_fullsized":"2024-09-16T17:01:20.329200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"88'681","reported_seq":717,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.990972+0000","last_change":"2024-09-16T16:59:47.411470+0000","last_active":"2024-09-16T17:01:23.990972+0000","last_peered":"2024-09-16T17:01:23.990972+0000","last_clean":"2024-09-16T17:01:23.990972+0000","last_became_active":"2024-09-16T16:59:47.345957+0000","last_became_peered":"2024-09-16T16:59:47.345957+0000","last_unstale":"2024-09-16T17:01:23.990972+0000","last_undegraded":"2024-09-16T17:01:23.990972+0000","last_fullsized":"2024-09-16T17:01:23.990972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.349005+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:20.349005+0000","last_peered":"2024-09-16T17:01:20.349005+0000","last_clean":"2024-09-16T17:01:20.349005+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:20.349005+0000","last_undegraded":"2024-09-16T17:01:20.349005+0000","last_fullsized":"2024-09-16T17:01:20.349005+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"88'522","reported_seq":559,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.141207+0000","last_change":"2024-09-16T16:59:47.546872+0000","last_active":"2024-09-16T17:01:24.141207+0000","last_peered":"2024-09-16T17:01:24.141207+0000","last_clean":"2024-09-16T17:01:24.141207+0000","last_became_active":"2024-09-16T16:59:47.534695+0000","last_became_peered":"2024-09-16T16:59:47.534695+0000","last_unstale":"2024-09-16T17:01:24.141207+0000","last_undegraded":"2024-09-16T17:01:24.141207+0000","last_fullsized":"2024-09-16T17:01:24.141207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2277400,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":522,"num_write_kb":3953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.238593+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:20.238593+0000","last_peered":"2024-09-16T17:01:20.238593+0000","last_clean":"2024-09-16T17:01:20.238593+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:20.238593+0000","last_undegraded":"2024-09-16T17:01:20.238593+0000","last_fullsized":"2024-09-16T17:01:20.238593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"88'516","reported_seq":552,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:23.849271+0000","last_change":"2024-09-16T16:59:47.492141+0000","last_active":"2024-09-16T17:01:23.849271+0000","last_peered":"2024-09-16T17:01:23.849271+0000","last_clean":"2024-09-16T17:01:23.849271+0000","last_became_active":"2024-09-16T16:59:47.481562+0000","last_became_peered":"2024-09-16T16:59:47.481562+0000","last_unstale":"2024-09-16T17:01:23.849271+0000","last_undegraded":"2024-09-16T17:01:23.849271+0000","last_fullsized":"2024-09-16T17:01:23.849271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.344814+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:20.344814+0000","last_peered":"2024-09-16T17:01:20.344814+0000","last_clean":"2024-09-16T17:01:20.344814+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:20.344814+0000","last_undegraded":"2024-09-16T17:01:20.344814+0000","last_fullsized":"2024-09-16T17:01:20.344814+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"88'628","reported_seq":664,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:24.223323+0000","last_change":"2024-09-16T16:59:47.492436+0000","last_active":"2024-09-16T17:01:24.223323+0000","last_peered":"2024-09-16T17:01:24.223323+0000","last_clean":"2024-09-16T17:01:24.223323+0000","last_became_active":"2024-09-16T16:59:47.482173+0000","last_became_peered":"2024-09-16T16:59:47.482173+0000","last_unstale":"2024-09-16T17:01:24.223323+0000","last_undegraded":"2024-09-16T17:01:24.223323+0000","last_fullsized":"2024-09-16T17:01:24.223323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:59:46.211527+0000","last_clean_scrub_stamp":"2024-09-16T16:59:46.211527+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-16T17:01:20.243946+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:20.243946+0000","last_peered":"2024-09-16T17:01:20.243946+0000","last_clean":"2024-09-16T17:01:20.243946+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:20.243946+0000","last_undegraded":"2024-09-16T17:01:20.243946+0000","last_fullsized":"2024-09-16T17:01:20.243946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":38125592,"num_objects":583,"num_object_clones":0,"num_object_copies":1749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9245,"num_write_kb":69873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213955670016,"internally_reserved":0,"allocated":255823872,"data_stored":255823872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9245,"ondisk_log_size":9245,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":213955538944,"internally_reserved":0,"allocated":255954944,"data_stored":255954944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":51760,"kb_used_data":51760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52245968,"statfs":{"total":53552873472,"available":53499871232,"internally_reserved":0,"allocated":53002240,"data_stored":53002240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":76908,"kb_used_data":76908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52220820,"statfs":{"total":53552873472,"available":53474119680,"internally_reserved":0,"allocated":78753792,"data_stored":78753792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":65804,"kb_used_data":65804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52231924,"statfs":{"total":53552873472,"available":53485490176,"internally_reserved":0,"allocated":67383296,"data_stored":67383296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":72908,"kb_used_data":72908,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52224820,"statfs":{"total":53552873472,"available":53478215680,"internally_reserved":0,"allocated":74657792,"data_stored":74657792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53481529344,"internally_reserved":0,"allocated":71344128,"data_stored":71344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53490618368,"internally_reserved":0,"allocated":62255104,"data_stored":62255104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53478084608,"internally_reserved":0,"allocated":74788864,"data_stored":74788864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":53552873472,"available":53481660416,"internally_reserved":0,"allocated":71213056,"data_stored":71213056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":53552873472,"available":53490618368,"internally_reserved":0,"allocated":62255104,"data_stored":62255104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":53552873472,"available":53478084608,"internally_reserved":0,"allocated":74788864,"data_stored":74788864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":53552873472,"available":53505306624,"internally_reserved":0,"allocated":47566848,"data_stored":47566848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:33.231 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'unique_pool_7' removed 2024-09-16T17:01:33.250 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-16T17:01:33.259 INFO:tasks.thrashosds:joining thrashosds 2024-09-16T17:01:38.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-16T17:01:38.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:38.231+0000 7f15d74d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:38.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:38.238+0000 7f15d74d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:38.254 INFO:teuthology.orchestra.run.smithi002.stdout:{} 2024-09-16T17:01:38.255 INFO:teuthology.orchestra.run.smithi002.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T17:01:38.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T17:01:38.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:38.374+0000 7f8a3185c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:38.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:38.385+0000 7f8a3185c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T17:01:39.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-16T17:01:39.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:39.309+0000 7f97d7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:39.322+0000 7f97d7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:40.178 INFO:teuthology.orchestra.run.smithi002.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-16T17:01:40.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T17:01:40.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:40.312+0000 7f12a9ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:40.323+0000 7f12a9ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:41.187 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T17:01:41.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-16T17:01:41.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:41.327+0000 7fcd486fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:41.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:41.338+0000 7fcd486fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:42.168 INFO:teuthology.orchestra.run.smithi002.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-16T17:01:42.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T17:01:42.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:42.302+0000 7f5f10791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:42.313+0000 7f5f10791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T17:01:43.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-16T17:01:43.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:43.332+0000 7fcb45f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:43.343+0000 7fcb45f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:44.192 INFO:teuthology.orchestra.run.smithi002.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-16T17:01:44.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T17:01:44.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:44.323+0000 7fad09ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:44.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:44.333+0000 7fad09ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:45.199 INFO:teuthology.orchestra.run.smithi002.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T17:01:45.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-16T17:01:45.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:45.339+0000 7f3073857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:45.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:45.350+0000 7f3073857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-16T17:01:46.230 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-16T17:01:46.230 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T17:01:46.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:01:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:46.342+0000 7fb78946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:46.350+0000 7fb78946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.550 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:46.551 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":98,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T17:01:46.203649+0000","last_up_change":"2024-09-16T16:46:54.148710+0000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:54.401070+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:57.342737+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1494647852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1494647852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1494647852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":1494647852}]},"public_addr":"172.21.15.2:6800/1494647852","cluster_addr":"172.21.15.2:6801/1494647852","heartbeat_back_addr":"172.21.15.2:6806/1494647852","heartbeat_front_addr":"172.21.15.2:6807/1494647852","state":["exists","up"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":983989567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":983989567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":983989567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6817","nonce":983989567}]},"public_addr":"172.21.15.2:6802/983989567","cluster_addr":"172.21.15.2:6803/983989567","heartbeat_back_addr":"172.21.15.2:6816/983989567","heartbeat_front_addr":"172.21.15.2:6817/983989567","state":["exists","up"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1898686600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":1898686600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1898686600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6813","nonce":1898686600}]},"public_addr":"172.21.15.110:6806/1898686600","cluster_addr":"172.21.15.110:6807/1898686600","heartbeat_back_addr":"172.21.15.110:6812/1898686600","heartbeat_front_addr":"172.21.15.110:6813/1898686600","state":["exists","up"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2099580700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":2099580700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2099580700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6809","nonce":2099580700}]},"public_addr":"172.21.15.110:6804/2099580700","cluster_addr":"172.21.15.110:6803/2099580700","heartbeat_back_addr":"172.21.15.110:6810/2099580700","heartbeat_front_addr":"172.21.15.110:6809/2099580700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:01:46.564 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T17:01:46.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:01:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:46.672+0000 7f67cac57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:46.681+0000 7f67cac57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:46.878 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:46.879 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":98,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T17:01:46.203649+0000","last_up_change":"2024-09-16T16:46:54.148710+0000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:54.401070+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:57.342737+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1494647852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1494647852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1494647852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":1494647852}]},"public_addr":"172.21.15.2:6800/1494647852","cluster_addr":"172.21.15.2:6801/1494647852","heartbeat_back_addr":"172.21.15.2:6806/1494647852","heartbeat_front_addr":"172.21.15.2:6807/1494647852","state":["exists","up"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":983989567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":983989567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":983989567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6817","nonce":983989567}]},"public_addr":"172.21.15.2:6802/983989567","cluster_addr":"172.21.15.2:6803/983989567","heartbeat_back_addr":"172.21.15.2:6816/983989567","heartbeat_front_addr":"172.21.15.2:6817/983989567","state":["exists","up"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1898686600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":1898686600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1898686600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6813","nonce":1898686600}]},"public_addr":"172.21.15.110:6806/1898686600","cluster_addr":"172.21.15.110:6807/1898686600","heartbeat_back_addr":"172.21.15.110:6812/1898686600","heartbeat_front_addr":"172.21.15.110:6813/1898686600","state":["exists","up"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2099580700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":2099580700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2099580700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6809","nonce":2099580700}]},"public_addr":"172.21.15.110:6804/2099580700","cluster_addr":"172.21.15.110:6803/2099580700","heartbeat_back_addr":"172.21.15.110:6810/2099580700","heartbeat_front_addr":"172.21.15.110:6809/2099580700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:01:46.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T17:01:46.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T17:01:46.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T17:01:46.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T17:01:47.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.013+0000 7febaf151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.013+0000 7f0540391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.013+0000 7fe62d097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.013+0000 7fc81a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.024+0000 7febaf151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.024+0000 7fe62d097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.024+0000 7fc81a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.025+0000 7f0540391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.064 INFO:teuthology.orchestra.run.smithi002.stdout:42949673852 2024-09-16T17:01:47.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T17:01:47.065 INFO:teuthology.orchestra.run.smithi002.stdout:42949673851 2024-09-16T17:01:47.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T17:01:47.067 INFO:teuthology.orchestra.run.smithi002.stdout:42949673852 2024-09-16T17:01:47.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T17:01:47.069 INFO:teuthology.orchestra.run.smithi002.stdout:38654706556 2024-09-16T17:01:47.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T17:01:47.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.178+0000 7fa3b3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.182+0000 7f9efc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.190+0000 7fa3b3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.195+0000 7f9efc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.228+0000 7fa4f3063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.230+0000 7fc1b7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.239+0000 7fa4f3063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:47.242+0000 7fc1b7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:47.437 INFO:teuthology.orchestra.run.smithi002.stdout:42949673829 2024-09-16T17:01:47.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673851 got 42949673829 for osd.2 2024-09-16T17:01:47.484 INFO:teuthology.orchestra.run.smithi002.stdout:42949673829 2024-09-16T17:01:47.505 INFO:teuthology.orchestra.run.smithi002.stdout:42949673829 2024-09-16T17:01:47.506 INFO:teuthology.orchestra.run.smithi002.stdout:38654706534 2024-09-16T17:01:47.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673852 got 42949673829 for osd.3 2024-09-16T17:01:47.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673852 got 42949673829 for osd.1 2024-09-16T17:01:47.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706556 got 38654706534 for osd.0 2024-09-16T17:01:48.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T17:01:48.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T17:01:48.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T17:01:48.511 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T17:01:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.582+0000 7f2707c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.596+0000 7f2707c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.629+0000 7f8e6b908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.630+0000 7f701cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.641+0000 7f8e6b908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.643+0000 7f701cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.679+0000 7ff40c646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:48.690+0000 7ff40c646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:48.808 INFO:teuthology.orchestra.run.smithi002.stdout:42949673829 2024-09-16T17:01:48.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673851 got 42949673829 for osd.2 2024-09-16T17:01:48.875 INFO:teuthology.orchestra.run.smithi002.stdout:42949673829 2024-09-16T17:01:48.885 INFO:teuthology.orchestra.run.smithi002.stdout:42949673829 2024-09-16T17:01:48.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673852 got 42949673829 for osd.3 2024-09-16T17:01:48.893 INFO:teuthology.orchestra.run.smithi002.stdout:38654706534 2024-09-16T17:01:48.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673852 got 42949673829 for osd.1 2024-09-16T17:01:48.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706556 got 38654706534 for osd.0 2024-09-16T17:01:49.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T17:01:49.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T17:01:49.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T17:01:49.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T17:01:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:49.947+0000 7f1e05f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:49.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:49.959+0000 7f1e05f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.010+0000 7ff57fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.024+0000 7ff57fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.051+0000 7f409eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.052+0000 7ff0c266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.062+0000 7f409eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.062+0000 7ff0c266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:42949673851 2024-09-16T17:01:50.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673851 got 42949673851 for osd.2 2024-09-16T17:01:50.191 DEBUG:teuthology.parallel:result is None 2024-09-16T17:01:50.241 INFO:teuthology.orchestra.run.smithi002.stdout:42949673852 2024-09-16T17:01:50.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673852 got 42949673852 for osd.3 2024-09-16T17:01:50.255 DEBUG:teuthology.parallel:result is None 2024-09-16T17:01:50.271 INFO:teuthology.orchestra.run.smithi002.stdout:38654706556 2024-09-16T17:01:50.276 INFO:teuthology.orchestra.run.smithi002.stdout:42949673852 2024-09-16T17:01:50.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706556 got 38654706556 for osd.0 2024-09-16T17:01:50.286 DEBUG:teuthology.parallel:result is None 2024-09-16T17:01:50.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673852 got 42949673852 for osd.1 2024-09-16T17:01:50.290 DEBUG:teuthology.parallel:result is None 2024-09-16T17:01:50.290 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T17:01:50.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:50.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.438+0000 7fcb8b4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.447+0000 7fcb8b4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.642 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:50.642 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:50.655 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2024-09-16T17:01:50.537012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8936,"kb_used_data":8936,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181976,"statfs":{"total":214211493888,"available":214202343424,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.343957"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":334,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.223596+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:46.223596+0000","last_peered":"2024-09-16T17:01:46.223596+0000","last_clean":"2024-09-16T17:01:46.223596+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:46.223596+0000","last_undegraded":"2024-09-16T17:01:46.223596+0000","last_fullsized":"2024-09-16T17:01:46.223596+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":260,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.233021+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:46.233021+0000","last_peered":"2024-09-16T17:01:46.233021+0000","last_clean":"2024-09-16T17:01:46.233021+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:46.233021+0000","last_undegraded":"2024-09-16T17:01:46.233021+0000","last_fullsized":"2024-09-16T17:01:46.233021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.236034+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:01:46.236034+0000","last_peered":"2024-09-16T17:01:46.236034+0000","last_clean":"2024-09-16T17:01:46.236034+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:46.236034+0000","last_undegraded":"2024-09-16T17:01:46.236034+0000","last_fullsized":"2024-09-16T17:01:46.236034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.229588+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:46.229588+0000","last_peered":"2024-09-16T17:01:46.229588+0000","last_clean":"2024-09-16T17:01:46.229588+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:46.229588+0000","last_undegraded":"2024-09-16T17:01:46.229588+0000","last_fullsized":"2024-09-16T17:01:46.229588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.230293+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:01:46.230293+0000","last_peered":"2024-09-16T17:01:46.230293+0000","last_clean":"2024-09-16T17:01:46.230293+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:46.230293+0000","last_undegraded":"2024-09-16T17:01:46.230293+0000","last_fullsized":"2024-09-16T17:01:46.230293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.227121+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:46.227121+0000","last_peered":"2024-09-16T17:01:46.227121+0000","last_clean":"2024-09-16T17:01:46.227121+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:46.227121+0000","last_undegraded":"2024-09-16T17:01:46.227121+0000","last_fullsized":"2024-09-16T17:01:46.227121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226767+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:46.226767+0000","last_peered":"2024-09-16T17:01:46.226767+0000","last_clean":"2024-09-16T17:01:46.226767+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:46.226767+0000","last_undegraded":"2024-09-16T17:01:46.226767+0000","last_fullsized":"2024-09-16T17:01:46.226767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226734+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:46.226734+0000","last_peered":"2024-09-16T17:01:46.226734+0000","last_clean":"2024-09-16T17:01:46.226734+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:46.226734+0000","last_undegraded":"2024-09-16T17:01:46.226734+0000","last_fullsized":"2024-09-16T17:01:46.226734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.231717+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:46.231717+0000","last_peered":"2024-09-16T17:01:46.231717+0000","last_clean":"2024-09-16T17:01:46.231717+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:46.231717+0000","last_undegraded":"2024-09-16T17:01:46.231717+0000","last_fullsized":"2024-09-16T17:01:46.231717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2588,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295140,"statfs":{"total":53552873472,"available":53550223360,"internally_reserved":0,"allocated":2650112,"data_stored":2650112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:50.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:50.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.763+0000 7f02bad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:50.772+0000 7f02bad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:50.967 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:50.967 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:50.980 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2024-09-16T17:01:50.537012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8936,"kb_used_data":8936,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181976,"statfs":{"total":214211493888,"available":214202343424,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.343957"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":334,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.223596+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:46.223596+0000","last_peered":"2024-09-16T17:01:46.223596+0000","last_clean":"2024-09-16T17:01:46.223596+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:46.223596+0000","last_undegraded":"2024-09-16T17:01:46.223596+0000","last_fullsized":"2024-09-16T17:01:46.223596+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":260,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.233021+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:46.233021+0000","last_peered":"2024-09-16T17:01:46.233021+0000","last_clean":"2024-09-16T17:01:46.233021+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:46.233021+0000","last_undegraded":"2024-09-16T17:01:46.233021+0000","last_fullsized":"2024-09-16T17:01:46.233021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.236034+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:01:46.236034+0000","last_peered":"2024-09-16T17:01:46.236034+0000","last_clean":"2024-09-16T17:01:46.236034+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:46.236034+0000","last_undegraded":"2024-09-16T17:01:46.236034+0000","last_fullsized":"2024-09-16T17:01:46.236034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.229588+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:46.229588+0000","last_peered":"2024-09-16T17:01:46.229588+0000","last_clean":"2024-09-16T17:01:46.229588+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:46.229588+0000","last_undegraded":"2024-09-16T17:01:46.229588+0000","last_fullsized":"2024-09-16T17:01:46.229588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.230293+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:01:46.230293+0000","last_peered":"2024-09-16T17:01:46.230293+0000","last_clean":"2024-09-16T17:01:46.230293+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:46.230293+0000","last_undegraded":"2024-09-16T17:01:46.230293+0000","last_fullsized":"2024-09-16T17:01:46.230293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.227121+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:46.227121+0000","last_peered":"2024-09-16T17:01:46.227121+0000","last_clean":"2024-09-16T17:01:46.227121+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:46.227121+0000","last_undegraded":"2024-09-16T17:01:46.227121+0000","last_fullsized":"2024-09-16T17:01:46.227121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226767+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:46.226767+0000","last_peered":"2024-09-16T17:01:46.226767+0000","last_clean":"2024-09-16T17:01:46.226767+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:46.226767+0000","last_undegraded":"2024-09-16T17:01:46.226767+0000","last_fullsized":"2024-09-16T17:01:46.226767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226734+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:46.226734+0000","last_peered":"2024-09-16T17:01:46.226734+0000","last_clean":"2024-09-16T17:01:46.226734+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:46.226734+0000","last_undegraded":"2024-09-16T17:01:46.226734+0000","last_fullsized":"2024-09-16T17:01:46.226734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.231717+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:46.231717+0000","last_peered":"2024-09-16T17:01:46.231717+0000","last_clean":"2024-09-16T17:01:46.231717+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:46.231717+0000","last_undegraded":"2024-09-16T17:01:46.231717+0000","last_fullsized":"2024-09-16T17:01:46.231717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2588,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295140,"statfs":{"total":53552873472,"available":53550223360,"internally_reserved":0,"allocated":2650112,"data_stored":2650112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:50.981 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T17:01:50.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-16T17:01:51.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:51.090+0000 7fad916c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:51.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:51.101+0000 7fad916c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:51.316 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T17:01:51.328 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T17:01:51.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:51.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:51.437+0000 7fee3e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:51.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:51.445+0000 7fee3e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:51.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:51.641 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:51.654 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2024-09-16T17:01:50.537012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8936,"kb_used_data":8936,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181976,"statfs":{"total":214211493888,"available":214202343424,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.343957"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":334,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.223596+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:46.223596+0000","last_peered":"2024-09-16T17:01:46.223596+0000","last_clean":"2024-09-16T17:01:46.223596+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:46.223596+0000","last_undegraded":"2024-09-16T17:01:46.223596+0000","last_fullsized":"2024-09-16T17:01:46.223596+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":260,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.233021+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:46.233021+0000","last_peered":"2024-09-16T17:01:46.233021+0000","last_clean":"2024-09-16T17:01:46.233021+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:46.233021+0000","last_undegraded":"2024-09-16T17:01:46.233021+0000","last_fullsized":"2024-09-16T17:01:46.233021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.236034+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:01:46.236034+0000","last_peered":"2024-09-16T17:01:46.236034+0000","last_clean":"2024-09-16T17:01:46.236034+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:46.236034+0000","last_undegraded":"2024-09-16T17:01:46.236034+0000","last_fullsized":"2024-09-16T17:01:46.236034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.229588+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:46.229588+0000","last_peered":"2024-09-16T17:01:46.229588+0000","last_clean":"2024-09-16T17:01:46.229588+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:46.229588+0000","last_undegraded":"2024-09-16T17:01:46.229588+0000","last_fullsized":"2024-09-16T17:01:46.229588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.230293+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:01:46.230293+0000","last_peered":"2024-09-16T17:01:46.230293+0000","last_clean":"2024-09-16T17:01:46.230293+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:46.230293+0000","last_undegraded":"2024-09-16T17:01:46.230293+0000","last_fullsized":"2024-09-16T17:01:46.230293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.227121+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:46.227121+0000","last_peered":"2024-09-16T17:01:46.227121+0000","last_clean":"2024-09-16T17:01:46.227121+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:46.227121+0000","last_undegraded":"2024-09-16T17:01:46.227121+0000","last_fullsized":"2024-09-16T17:01:46.227121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226767+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:46.226767+0000","last_peered":"2024-09-16T17:01:46.226767+0000","last_clean":"2024-09-16T17:01:46.226767+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:46.226767+0000","last_undegraded":"2024-09-16T17:01:46.226767+0000","last_fullsized":"2024-09-16T17:01:46.226767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226734+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:46.226734+0000","last_peered":"2024-09-16T17:01:46.226734+0000","last_clean":"2024-09-16T17:01:46.226734+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:46.226734+0000","last_undegraded":"2024-09-16T17:01:46.226734+0000","last_fullsized":"2024-09-16T17:01:46.226734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.231717+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:46.231717+0000","last_peered":"2024-09-16T17:01:46.231717+0000","last_clean":"2024-09-16T17:01:46.231717+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:46.231717+0000","last_undegraded":"2024-09-16T17:01:46.231717+0000","last_fullsized":"2024-09-16T17:01:46.231717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2588,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295140,"statfs":{"total":53552873472,"available":53550223360,"internally_reserved":0,"allocated":2650112,"data_stored":2650112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:51.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:51.762+0000 7f01024d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:51.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:51.772+0000 7f01024d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:51.968 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:51.981 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2024-09-16T17:01:50.537012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8936,"kb_used_data":8936,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181976,"statfs":{"total":214211493888,"available":214202343424,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.343957"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":334,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.223596+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:46.223596+0000","last_peered":"2024-09-16T17:01:46.223596+0000","last_clean":"2024-09-16T17:01:46.223596+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:46.223596+0000","last_undegraded":"2024-09-16T17:01:46.223596+0000","last_fullsized":"2024-09-16T17:01:46.223596+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":260,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.233021+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:46.233021+0000","last_peered":"2024-09-16T17:01:46.233021+0000","last_clean":"2024-09-16T17:01:46.233021+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:46.233021+0000","last_undegraded":"2024-09-16T17:01:46.233021+0000","last_fullsized":"2024-09-16T17:01:46.233021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.236034+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:01:46.236034+0000","last_peered":"2024-09-16T17:01:46.236034+0000","last_clean":"2024-09-16T17:01:46.236034+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:46.236034+0000","last_undegraded":"2024-09-16T17:01:46.236034+0000","last_fullsized":"2024-09-16T17:01:46.236034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.229588+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:46.229588+0000","last_peered":"2024-09-16T17:01:46.229588+0000","last_clean":"2024-09-16T17:01:46.229588+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:46.229588+0000","last_undegraded":"2024-09-16T17:01:46.229588+0000","last_fullsized":"2024-09-16T17:01:46.229588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.230293+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:01:46.230293+0000","last_peered":"2024-09-16T17:01:46.230293+0000","last_clean":"2024-09-16T17:01:46.230293+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:46.230293+0000","last_undegraded":"2024-09-16T17:01:46.230293+0000","last_fullsized":"2024-09-16T17:01:46.230293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.227121+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:46.227121+0000","last_peered":"2024-09-16T17:01:46.227121+0000","last_clean":"2024-09-16T17:01:46.227121+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:46.227121+0000","last_undegraded":"2024-09-16T17:01:46.227121+0000","last_fullsized":"2024-09-16T17:01:46.227121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226767+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:46.226767+0000","last_peered":"2024-09-16T17:01:46.226767+0000","last_clean":"2024-09-16T17:01:46.226767+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:46.226767+0000","last_undegraded":"2024-09-16T17:01:46.226767+0000","last_fullsized":"2024-09-16T17:01:46.226767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226734+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:46.226734+0000","last_peered":"2024-09-16T17:01:46.226734+0000","last_clean":"2024-09-16T17:01:46.226734+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:46.226734+0000","last_undegraded":"2024-09-16T17:01:46.226734+0000","last_fullsized":"2024-09-16T17:01:46.226734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.231717+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:46.231717+0000","last_peered":"2024-09-16T17:01:46.231717+0000","last_clean":"2024-09-16T17:01:46.231717+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:46.231717+0000","last_undegraded":"2024-09-16T17:01:46.231717+0000","last_fullsized":"2024-09-16T17:01:46.231717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2588,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295140,"statfs":{"total":53552873472,"available":53550223360,"internally_reserved":0,"allocated":2650112,"data_stored":2650112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:51.982 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T17:01:51.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:52.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:52.089+0000 7f87888ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:52.098+0000 7f87888ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.293 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:52.294 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:52.307 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2024-09-16T17:01:50.537012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8936,"kb_used_data":8936,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181976,"statfs":{"total":214211493888,"available":214202343424,"internally_reserved":0,"allocated":9150464,"data_stored":9150464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.343957"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":334,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.223596+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:46.223596+0000","last_peered":"2024-09-16T17:01:46.223596+0000","last_clean":"2024-09-16T17:01:46.223596+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:46.223596+0000","last_undegraded":"2024-09-16T17:01:46.223596+0000","last_fullsized":"2024-09-16T17:01:46.223596+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":260,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.233021+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:46.233021+0000","last_peered":"2024-09-16T17:01:46.233021+0000","last_clean":"2024-09-16T17:01:46.233021+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:46.233021+0000","last_undegraded":"2024-09-16T17:01:46.233021+0000","last_fullsized":"2024-09-16T17:01:46.233021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.236034+0000","last_change":"2024-09-16T16:47:01.219246+0000","last_active":"2024-09-16T17:01:46.236034+0000","last_peered":"2024-09-16T17:01:46.236034+0000","last_clean":"2024-09-16T17:01:46.236034+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:46.236034+0000","last_undegraded":"2024-09-16T17:01:46.236034+0000","last_fullsized":"2024-09-16T17:01:46.236034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.229588+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:46.229588+0000","last_peered":"2024-09-16T17:01:46.229588+0000","last_clean":"2024-09-16T17:01:46.229588+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:46.229588+0000","last_undegraded":"2024-09-16T17:01:46.229588+0000","last_fullsized":"2024-09-16T17:01:46.229588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.230293+0000","last_change":"2024-09-16T16:47:01.211386+0000","last_active":"2024-09-16T17:01:46.230293+0000","last_peered":"2024-09-16T17:01:46.230293+0000","last_clean":"2024-09-16T17:01:46.230293+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:46.230293+0000","last_undegraded":"2024-09-16T17:01:46.230293+0000","last_fullsized":"2024-09-16T17:01:46.230293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.227121+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:46.227121+0000","last_peered":"2024-09-16T17:01:46.227121+0000","last_clean":"2024-09-16T17:01:46.227121+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:46.227121+0000","last_undegraded":"2024-09-16T17:01:46.227121+0000","last_fullsized":"2024-09-16T17:01:46.227121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226767+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:46.226767+0000","last_peered":"2024-09-16T17:01:46.226767+0000","last_clean":"2024-09-16T17:01:46.226767+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:46.226767+0000","last_undegraded":"2024-09-16T17:01:46.226767+0000","last_fullsized":"2024-09-16T17:01:46.226767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226734+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:46.226734+0000","last_peered":"2024-09-16T17:01:46.226734+0000","last_clean":"2024-09-16T17:01:46.226734+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:46.226734+0000","last_undegraded":"2024-09-16T17:01:46.226734+0000","last_fullsized":"2024-09-16T17:01:46.226734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.231717+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:46.231717+0000","last_peered":"2024-09-16T17:01:46.231717+0000","last_clean":"2024-09-16T17:01:46.231717+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:46.231717+0000","last_undegraded":"2024-09-16T17:01:46.231717+0000","last_fullsized":"2024-09-16T17:01:46.231717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2588,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295140,"statfs":{"total":53552873472,"available":53550223360,"internally_reserved":0,"allocated":2650112,"data_stored":2650112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:52.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T17:01:52.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:52.416+0000 7f6934f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:52.424+0000 7f6934f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:52.624 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:52.625 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":98,"fsid":"c4016161-76cd-4174-ba7b-1295c2a4f0b9","created":"2024-09-16T16:46:47.048657+0000","modified":"2024-09-16T17:01:46.203649+0000","last_up_change":"2024-09-16T16:46:54.148710+0000","last_in_change":"2024-09-16T16:46:49.164959+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T16:46:54.401070+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T16:46:57.342737+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e22e91d1-01fb-42aa-a17f-81c0cddb4ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1494647852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6801","nonce":1494647852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1494647852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6807","nonce":1494647852}]},"public_addr":"172.21.15.2:6800/1494647852","cluster_addr":"172.21.15.2:6801/1494647852","heartbeat_back_addr":"172.21.15.2:6806/1494647852","heartbeat_front_addr":"172.21.15.2:6807/1494647852","state":["exists","up"]},{"osd":1,"uuid":"ff18a013-2e71-4d79-b38c-4a24893a1238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":983989567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6803","nonce":983989567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":983989567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6817","nonce":983989567}]},"public_addr":"172.21.15.2:6802/983989567","cluster_addr":"172.21.15.2:6803/983989567","heartbeat_back_addr":"172.21.15.2:6816/983989567","heartbeat_front_addr":"172.21.15.2:6817/983989567","state":["exists","up"]},{"osd":2,"uuid":"44c5c2b9-81de-44d6-99d1-260e3d24c59c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1898686600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":1898686600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1898686600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6813","nonce":1898686600}]},"public_addr":"172.21.15.110:6806/1898686600","cluster_addr":"172.21.15.110:6807/1898686600","heartbeat_back_addr":"172.21.15.110:6812/1898686600","heartbeat_front_addr":"172.21.15.110:6813/1898686600","state":["exists","up"]},{"osd":3,"uuid":"95738d6c-1956-4c40-a479-f8d46df7d0d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2099580700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":2099580700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2099580700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6809","nonce":2099580700}]},"public_addr":"172.21.15.110:6804/2099580700","cluster_addr":"172.21.15.110:6803/2099580700","heartbeat_back_addr":"172.21.15.110:6810/2099580700","heartbeat_front_addr":"172.21.15.110:6809/2099580700","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T17:01:53.639 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T17:01:53.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:01:53.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:53.762+0000 7faf68f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:53.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:53.776+0000 7faf68f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:53.793 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-16T17:01:53.794 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "" 2024-09-16T17:01:53.794 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-16T17:01:53.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T17:01:53.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:53.914+0000 7fc715f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:53.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:53.924+0000 7fc715f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T17:01:54.141 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T17:01:54.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:01:54.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.250+0000 7f9cc1c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.263+0000 7f9cc1c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.281 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-16T17:01:54.281 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "" 2024-09-16T17:01:54.281 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-16T17:01:54.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T17:01:54.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.400+0000 7f8819791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.410+0000 7f8819791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.609 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T17:01:54.632 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T17:01:54.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:01:54.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.740+0000 7f5af24fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.753+0000 7f5af24fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.770 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-16T17:01:54.771 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "" 2024-09-16T17:01:54.771 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-16T17:01:54.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T17:01:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.889+0000 7f7614511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:54.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:54.899+0000 7f7614511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T17:01:55.111 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T17:01:55.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T17:01:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:55.218+0000 7f2a3205c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:55.234+0000 7f2a3205c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.253 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-16T17:01:55.253 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "" 2024-09-16T17:01:55.253 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-16T17:01:55.264 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T17:01:55.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:55.377+0000 7fd17d8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:55.388+0000 7fd17d8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T17:01:55.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:01:55.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:55.720+0000 7f08b52d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:01:55.728+0000 7f08b52d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:01:55.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:01:55.929 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:01:55.941 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2024-09-16T17:01:54.537769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8952,"kb_used_data":8952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181960,"statfs":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.338421"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":334,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.223596+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:46.223596+0000","last_peered":"2024-09-16T17:01:46.223596+0000","last_clean":"2024-09-16T17:01:46.223596+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:46.223596+0000","last_undegraded":"2024-09-16T17:01:46.223596+0000","last_fullsized":"2024-09-16T17:01:46.223596+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":260,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.233021+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:46.233021+0000","last_peered":"2024-09-16T17:01:46.233021+0000","last_clean":"2024-09-16T17:01:46.233021+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:46.233021+0000","last_undegraded":"2024-09-16T17:01:46.233021+0000","last_fullsized":"2024-09-16T17:01:46.233021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.126560+0000","last_change":"2024-09-16T17:01:54.145085+0000","last_active":"2024-09-16T17:01:54.126560+0000","last_peered":"2024-09-16T17:01:54.126560+0000","last_clean":"2024-09-16T17:01:54.126560+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:54.126560+0000","last_undegraded":"2024-09-16T17:01:54.126560+0000","last_fullsized":"2024-09-16T17:01:54.126560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:54.144901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.144901+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.229588+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:46.229588+0000","last_peered":"2024-09-16T17:01:46.229588+0000","last_clean":"2024-09-16T17:01:46.229588+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:46.229588+0000","last_undegraded":"2024-09-16T17:01:46.229588+0000","last_fullsized":"2024-09-16T17:01:46.229588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":263,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.124863+0000","last_change":"2024-09-16T17:01:54.151019+0000","last_active":"2024-09-16T17:01:54.124863+0000","last_peered":"2024-09-16T17:01:54.124863+0000","last_clean":"2024-09-16T17:01:54.124863+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:54.124863+0000","last_undegraded":"2024-09-16T17:01:54.124863+0000","last_fullsized":"2024-09-16T17:01:54.124863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'2","last_scrub_stamp":"2024-09-16T17:01:54.150800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.150800+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.227121+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:46.227121+0000","last_peered":"2024-09-16T17:01:46.227121+0000","last_clean":"2024-09-16T17:01:46.227121+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:46.227121+0000","last_undegraded":"2024-09-16T17:01:46.227121+0000","last_fullsized":"2024-09-16T17:01:46.227121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226767+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:46.226767+0000","last_peered":"2024-09-16T17:01:46.226767+0000","last_clean":"2024-09-16T17:01:46.226767+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:46.226767+0000","last_undegraded":"2024-09-16T17:01:46.226767+0000","last_fullsized":"2024-09-16T17:01:46.226767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226734+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:46.226734+0000","last_peered":"2024-09-16T17:01:46.226734+0000","last_clean":"2024-09-16T17:01:46.226734+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:46.226734+0000","last_undegraded":"2024-09-16T17:01:46.226734+0000","last_fullsized":"2024-09-16T17:01:46.226734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.231717+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:46.231717+0000","last_peered":"2024-09-16T17:01:46.231717+0000","last_clean":"2024-09-16T17:01:46.231717+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:46.231717+0000","last_undegraded":"2024-09-16T17:01:46.231717+0000","last_fullsized":"2024-09-16T17:01:46.231717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2596,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295132,"statfs":{"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:01:55.945 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:46:55.154023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:01:55.945 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:01:55.945 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:01:55.945 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:01:55.946 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:01:55.946 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:01:55.946 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:01:55.946 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:02:15.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:16.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:02:16.069+0000 7fb1f9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:16.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:02:16.078+0000 7fb1f9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:16.280 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:02:16.280 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:02:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-09-16T17:02:14.542378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8952,"kb_used_data":8952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181960,"statfs":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002929"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":334,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.223596+0000","last_change":"2024-09-16T16:46:56.238346+0000","last_active":"2024-09-16T17:01:46.223596+0000","last_peered":"2024-09-16T17:01:46.223596+0000","last_clean":"2024-09-16T17:01:46.223596+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:46.223596+0000","last_undegraded":"2024-09-16T17:01:46.223596+0000","last_fullsized":"2024-09-16T17:01:46.223596+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:55.154023+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":260,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.233021+0000","last_change":"2024-09-16T16:47:01.217363+0000","last_active":"2024-09-16T17:01:46.233021+0000","last_peered":"2024-09-16T17:01:46.233021+0000","last_clean":"2024-09-16T17:01:46.233021+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:46.233021+0000","last_undegraded":"2024-09-16T17:01:46.233021+0000","last_fullsized":"2024-09-16T17:01:46.233021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.126560+0000","last_change":"2024-09-16T17:01:54.145085+0000","last_active":"2024-09-16T17:01:54.126560+0000","last_peered":"2024-09-16T17:01:54.126560+0000","last_clean":"2024-09-16T17:01:54.126560+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:54.126560+0000","last_undegraded":"2024-09-16T17:01:54.126560+0000","last_fullsized":"2024-09-16T17:01:54.126560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:54.144901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.144901+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.229588+0000","last_change":"2024-09-16T16:47:01.211363+0000","last_active":"2024-09-16T17:01:46.229588+0000","last_peered":"2024-09-16T17:01:46.229588+0000","last_clean":"2024-09-16T17:01:46.229588+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:46.229588+0000","last_undegraded":"2024-09-16T17:01:46.229588+0000","last_fullsized":"2024-09-16T17:01:46.229588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":263,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.124863+0000","last_change":"2024-09-16T17:01:54.151019+0000","last_active":"2024-09-16T17:01:54.124863+0000","last_peered":"2024-09-16T17:01:54.124863+0000","last_clean":"2024-09-16T17:01:54.124863+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:54.124863+0000","last_undegraded":"2024-09-16T17:01:54.124863+0000","last_fullsized":"2024-09-16T17:01:54.124863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'2","last_scrub_stamp":"2024-09-16T17:01:54.150800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.150800+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.227121+0000","last_change":"2024-09-16T16:47:01.210128+0000","last_active":"2024-09-16T17:01:46.227121+0000","last_peered":"2024-09-16T17:01:46.227121+0000","last_clean":"2024-09-16T17:01:46.227121+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:46.227121+0000","last_undegraded":"2024-09-16T17:01:46.227121+0000","last_fullsized":"2024-09-16T17:01:46.227121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226767+0000","last_change":"2024-09-16T16:47:01.209759+0000","last_active":"2024-09-16T17:01:46.226767+0000","last_peered":"2024-09-16T17:01:46.226767+0000","last_clean":"2024-09-16T17:01:46.226767+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:46.226767+0000","last_undegraded":"2024-09-16T17:01:46.226767+0000","last_fullsized":"2024-09-16T17:01:46.226767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.226734+0000","last_change":"2024-09-16T16:47:01.209880+0000","last_active":"2024-09-16T17:01:46.226734+0000","last_peered":"2024-09-16T17:01:46.226734+0000","last_clean":"2024-09-16T17:01:46.226734+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:46.226734+0000","last_undegraded":"2024-09-16T17:01:46.226734+0000","last_fullsized":"2024-09-16T17:01:46.226734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:46.231717+0000","last_change":"2024-09-16T16:47:01.217790+0000","last_active":"2024-09-16T17:01:46.231717+0000","last_peered":"2024-09-16T17:01:46.231717+0000","last_clean":"2024-09-16T17:01:46.231717+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:46.231717+0000","last_undegraded":"2024-09-16T17:01:46.231717+0000","last_fullsized":"2024-09-16T17:01:46.231717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T16:46:58.169379+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2596,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295132,"statfs":{"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706564,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:16.296 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T16:46:55.154023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:16.296 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:16.296 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:16.296 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:16.296 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:16.296 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:16.296 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T16:46:58.169379+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=16, tm_min=46, tm_sec=58, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=17, tm_min=1, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T17:02:16.296 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T17:02:36.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T17:02:36.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:02:36.420+0000 7f255b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:36.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:02:36.429+0000 7f255b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:36.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-16T17:02:36.629 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-16T17:02:36.642 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2024-09-16T17:02:36.547722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":8952,"kb_used_data":8952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209181960,"statfs":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003141"},"pg_stats":[{"pgid":"1.0","version":"12'52","reported_seq":336,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.599783+0000","last_change":"2024-09-16T17:01:55.646958+0000","last_active":"2024-09-16T17:01:55.599783+0000","last_peered":"2024-09-16T17:01:55.599783+0000","last_clean":"2024-09-16T17:01:55.599783+0000","last_became_active":"2024-09-16T16:46:56.217967+0000","last_became_peered":"2024-09-16T16:46:56.217967+0000","last_unstale":"2024-09-16T17:01:55.599783+0000","last_undegraded":"2024-09-16T17:01:55.599783+0000","last_fullsized":"2024-09-16T17:01:55.599783+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-16T17:01:55.646706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:55.646706+0000","last_clean_scrub_stamp":"2024-09-16T16:46:55.154023+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":262,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.613864+0000","last_change":"2024-09-16T17:01:54.639378+0000","last_active":"2024-09-16T17:01:54.613864+0000","last_peered":"2024-09-16T17:01:54.613864+0000","last_clean":"2024-09-16T17:01:54.613864+0000","last_became_active":"2024-09-16T16:46:59.310158+0000","last_became_peered":"2024-09-16T16:46:59.310158+0000","last_unstale":"2024-09-16T17:01:54.613864+0000","last_undegraded":"2024-09-16T17:01:54.613864+0000","last_fullsized":"2024-09-16T17:01:54.613864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-16T17:01:54.639165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.639165+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.126560+0000","last_change":"2024-09-16T17:01:54.145085+0000","last_active":"2024-09-16T17:01:54.126560+0000","last_peered":"2024-09-16T17:01:54.126560+0000","last_clean":"2024-09-16T17:01:54.126560+0000","last_became_active":"2024-09-16T16:46:59.287966+0000","last_became_peered":"2024-09-16T16:46:59.287966+0000","last_unstale":"2024-09-16T17:01:54.126560+0000","last_undegraded":"2024-09-16T17:01:54.126560+0000","last_fullsized":"2024-09-16T17:01:54.126560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:54.144901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.144901+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.611414+0000","last_change":"2024-09-16T17:01:54.627427+0000","last_active":"2024-09-16T17:01:54.611414+0000","last_peered":"2024-09-16T17:01:54.611414+0000","last_clean":"2024-09-16T17:01:54.611414+0000","last_became_active":"2024-09-16T16:46:59.265521+0000","last_became_peered":"2024-09-16T16:46:59.265521+0000","last_unstale":"2024-09-16T17:01:54.611414+0000","last_undegraded":"2024-09-16T17:01:54.611414+0000","last_fullsized":"2024-09-16T17:01:54.611414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:54.627132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.627132+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":263,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.124863+0000","last_change":"2024-09-16T17:01:54.151019+0000","last_active":"2024-09-16T17:01:54.124863+0000","last_peered":"2024-09-16T17:01:54.124863+0000","last_clean":"2024-09-16T17:01:54.124863+0000","last_became_active":"2024-09-16T16:46:59.314725+0000","last_became_peered":"2024-09-16T16:46:59.314725+0000","last_unstale":"2024-09-16T17:01:54.124863+0000","last_undegraded":"2024-09-16T17:01:54.124863+0000","last_fullsized":"2024-09-16T17:01:54.124863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'2","last_scrub_stamp":"2024-09-16T17:01:54.150800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.150800+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.099660+0000","last_change":"2024-09-16T17:01:55.116344+0000","last_active":"2024-09-16T17:01:55.099660+0000","last_peered":"2024-09-16T17:01:55.099660+0000","last_clean":"2024-09-16T17:01:55.099660+0000","last_became_active":"2024-09-16T16:46:59.277096+0000","last_became_peered":"2024-09-16T16:46:59.277096+0000","last_unstale":"2024-09-16T17:01:55.099660+0000","last_undegraded":"2024-09-16T17:01:55.099660+0000","last_fullsized":"2024-09-16T17:01:55.099660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:55.116150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:55.116150+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.601576+0000","last_change":"2024-09-16T17:01:55.625504+0000","last_active":"2024-09-16T17:01:55.601576+0000","last_peered":"2024-09-16T17:01:55.601576+0000","last_clean":"2024-09-16T17:01:55.601576+0000","last_became_active":"2024-09-16T16:46:59.289062+0000","last_became_peered":"2024-09-16T16:46:59.289062+0000","last_unstale":"2024-09-16T17:01:55.601576+0000","last_undegraded":"2024-09-16T17:01:55.601576+0000","last_fullsized":"2024-09-16T17:01:55.601576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:55.625143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:55.625143+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:55.099647+0000","last_change":"2024-09-16T17:01:55.114357+0000","last_active":"2024-09-16T17:01:55.099647+0000","last_peered":"2024-09-16T17:01:55.099647+0000","last_clean":"2024-09-16T17:01:55.099647+0000","last_became_active":"2024-09-16T16:46:59.278321+0000","last_became_peered":"2024-09-16T16:46:59.278321+0000","last_unstale":"2024-09-16T17:01:55.099647+0000","last_undegraded":"2024-09-16T17:01:55.099647+0000","last_fullsized":"2024-09-16T17:01:55.099647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:55.114163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:55.114163+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":261,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-16T17:01:54.613705+0000","last_change":"2024-09-16T17:01:54.634420+0000","last_active":"2024-09-16T17:01:54.613705+0000","last_peered":"2024-09-16T17:01:54.613705+0000","last_clean":"2024-09-16T17:01:54.613705+0000","last_became_active":"2024-09-16T16:46:59.285347+0000","last_became_peered":"2024-09-16T16:46:59.285347+0000","last_unstale":"2024-09-16T17:01:54.613705+0000","last_undegraded":"2024-09-16T17:01:54.613705+0000","last_fullsized":"2024-09-16T17:01:54.613705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T17:01:54.634240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T17:01:54.634240+0000","last_clean_scrub_stamp":"2024-09-16T16:46:58.169379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214202327040,"internally_reserved":0,"allocated":9166848,"data_stored":9166848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2596,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295132,"statfs":{"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1616,"kb_used_data":1616,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296112,"statfs":{"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551218688,"internally_reserved":0,"allocated":1654784,"data_stored":1654784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550215168,"internally_reserved":0,"allocated":2658304,"data_stored":2658304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T17:02:36.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T17:02:36.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:02:36.747+0000 7f20ecd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:36.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-16T17:02:36.760+0000 7f20ecd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T17:02:36.979 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T17:02:36.979 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T17:02:36.979 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T17:02:36.979 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:02:37.052 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T17:02:37.052 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T17:02:37.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:02:37.130 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T17:02:37.130 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T17:02:37.130 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:02:37.205 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T17:02:37.206 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T17:02:37.206 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:02:37.280 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T17:02:37.280 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T17:02:37.280 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T17:02:37.280 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:02:37.310 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T17:02:37.310 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T17:02:37.310 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T17:02:37.310 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T17:02:37.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-16T17:02:37.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-16T17:02:37.323 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T17:02:37.323 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T17:02:37.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-09-16T17:02:37.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-16T17:02:37.405 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T17:02:37.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-16T17:02:37.611 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T17:02:37.692 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T17:02:37.692 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T17:02:37.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T17:02:37.782 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T17:02:37.852 INFO:tasks.ceph:Archiving mon data... 2024-09-16T17:02:37.853 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394/data/mon.a.tgz 2024-09-16T17:02:37.853 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-16T17:02:37.869 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.U5yWIciEGF 2024-09-16T17:02:37.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.U5yWIciEGF 2024-09-16T17:02:37.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.U5yWIciEGF 2024-09-16T17:02:38.069 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.U5yWIciEGF is 219KB 2024-09-16T17:02:38.163 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.U5yWIciEGF 2024-09-16T17:02:38.179 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T17:02:38.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:02:38.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T17:02:38.299 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:02:38.316 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T17:02:38.316 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T17:02:38.318 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394/remote/smithi002/crash 2024-09-16T17:02:38.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:02:38.365 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394/remote/smithi110/crash 2024-09-16T17:02:38.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T17:02:38.438 INFO:tasks.ceph:Compressing logs... 2024-09-16T17:02:38.438 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:02:38.441 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T17:02:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T17:02:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35032.log 2024-09-16T17:02:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63120.log 2024-09-16T17:02:38.466 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.35032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37935.log 2024-09-16T17:02:38.466 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35032.log.gz 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45210.log 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63120.log.gz 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56638.log 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37935.log.gz 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59859.log 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45210.log.gz 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41214.log 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56638.log.gz 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37766.log 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59859.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59859.log.gz 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50881.log 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41214.log.gz 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60083.log 2024-09-16T17:02:38.467 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37766.log.gz 2024-09-16T17:02:38.468 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60273.log 2024-09-16T17:02:38.468 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50881.log.gz 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27967.log 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27876.log 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27920.log 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27967.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.27967.log.gz 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.27876.log: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.27876.log.gz 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.27920.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27920.log.gz 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27836.log 2024-09-16T17:02:38.472 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.27836.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27836.log.gz 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65900.log 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60083.log.gz 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40858.log 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60273.log.gz 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61380.log 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65900.log.gz 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41396.log 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40858.log.gz 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28842.log 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61380.log.gz 2024-09-16T17:02:38.547 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61569.log 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41396.log.gz 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47606.log 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28842.log.gz 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35529.log 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61569.log.gz 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45519.log 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47606.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47606.log.gz 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28376.log 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35529.log.gz 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45519.log.gz 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50921.log 2024-09-16T17:02:38.548 INFO:teuthology.orchestra.run.smithi002.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.28376.log.gz 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53699.log 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50692.log 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50921.log.gz 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37308.log 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53699.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53699.log.gz 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54525.log 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50692.log.gz 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37308.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37308.log.gzgzip 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40718.log 2024-09-16T17:02:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54665.log 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54525.log.gz 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54266.log 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40718.log.gz 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28297.log 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54665.log.gz 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44376.log 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54266.log.gz 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.28297.log: /var/log/ceph/ceph-client.admin.57419.log 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28297.log.gz 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29991.log 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44376.log.gz 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39298.log 2024-09-16T17:02:38.550 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57419.log.gz 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29991.log.gz 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39298.log.gz 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64850.log 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36822.log 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46480.log 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64850.log.gz 2024-09-16T17:02:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34366.log 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36822.log.gz 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41683.log 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46480.log.gz 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62364.log 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34366.log.gz 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52860.log 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41683.log.gz 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37388.log 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62364.log.gz 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49948.log 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52860.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52860.log.gz 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52052.log 2024-09-16T17:02:38.552 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37388.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37388.log.gz 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58370.log 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49948.log.gz 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61800.log 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52052.log.gz 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61478.log 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58370.log.gz 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64274.log 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61800.log.gz 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61478.log.gz 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64274.log.gz 2024-09-16T17:02:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46994.log 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49402.log 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35256.log 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46994.log.gz 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40271.log 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49402.log.gz 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29674.log 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35256.log.gz 2024-09-16T17:02:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61658.log 2024-09-16T17:02:38.555 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40271.log.gz 2024-09-16T17:02:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58588.log 2024-09-16T17:02:38.555 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29674.log.gz 2024-09-16T17:02:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-09-16T17:02:38.555 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61658.log.gz 2024-09-16T17:02:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61213.log 2024-09-16T17:02:38.556 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.58588.log.gz 2024-09-16T17:02:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53301.log 2024-09-16T17:02:38.556 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-09-16T17:02:38.556 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61213.log.gz 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34808.log 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53301.log.gz 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59035.log 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34808.log.gz 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45964.log 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59035.log.gz 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58726.log 2024-09-16T17:02:38.557 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43940.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45964.log.gz 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51397.log 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58726.log.gz 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56945.log 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41116.log 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51397.log.gz 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51528.log 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.56945.log.gz 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32908.log 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41116.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41116.log.gz 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2024-09-16T17:02:38.558 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51528.log.gz 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39150.log 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32908.log.gz 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45259.log 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48575.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65808.log 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39150.log.gz 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42172.log 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45259.log.gz 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40996.log 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65808.log.gz 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32997.log 2024-09-16T17:02:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42172.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42172.log.gz 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40996.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40996.log.gz -- 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.57264.log 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42437.log 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32997.log.gz 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57264.log.gz 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57920.log 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42437.log.gz 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60991.log 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60405.log 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57920.log.gz 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59355.log 2024-09-16T17:02:38.560 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60991.log.gz 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43186.log 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60405.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60405.log.gz 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65456.log 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59355.log.gz 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58000.log 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43186.log.gz 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32152.log 2024-09-16T17:02:38.561 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65456.log.gz 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33360.log 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58000.log.gz 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32152.log: gzip -5 --verbose 50.0% -- -- replaced with /var/log/ceph/ceph-client.admin.32152.log.gz /var/log/ceph/ceph-client.admin.31266.log 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55434.log 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33360.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33360.log.gz 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28884.log 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31266.log.gz 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34682.log 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55434.log.gz 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56026.log 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28884.log.gz 2024-09-16T17:02:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35345.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34682.log.gz 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.56026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35571.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64976.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35345.log.gz 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59075.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35571.log.gz 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35753.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64976.log.gz 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41516.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59075.log.gz 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40369.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35753.log.gz 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52564.log 2024-09-16T17:02:38.563 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41516.log.gz 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51179.log 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40369.log.gz 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66026.log 50.0% 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52564.log.gz 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49729.log 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51179.log.gz 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49867.log 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66026.log.gz 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49729.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49729.log.gz 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38214.log 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49867.log.gz 2024-09-16T17:02:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55975.log 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38214.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38214.log.gz 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64148.log 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38165.log 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55975.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55975.log.gz 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54218.log 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.64148.log.gz 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51970.log 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38165.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38165.log.gz 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54218.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54218.log.gz 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41076.log 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47651.log 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51970.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51970.log.gz 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41076.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41076.log.gz 2024-09-16T17:02:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62274.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65625.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47651.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47651.log.gz 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29949.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62274.log.gz 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54476.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65625.log.gz 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60034.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29949.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29949.log.gz 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54476.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54476.log.gz 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35795.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65732.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60034.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60034.log.gz 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36018.log 2024-09-16T17:02:38.566 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35795.log.gz 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45608.log 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65732.log.gz 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36018.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36018.log.gz 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34458.log 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31921.log 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45608.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45608.log.gz 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36591.log 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34458.log.gz 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32281.log 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31921.log.gz 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64354.log 2024-09-16T17:02:38.567 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36591.log.gz 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33494.log 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32281.log.gz 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56861.log 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64354.log.gz 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50732.log 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33494.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33494.log.gz 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38256.log 2024-09-16T17:02:38.568 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56861.log.gz 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48437.log 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50732.log.gz 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38256.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38256.log.gz 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39770.log 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44069.log: -- /var/log/ceph/ceph-client.admin.34724.log 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39770.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39770.log.gzgzip 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56280.log 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28983.log 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34724.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34724.log.gz 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65984.log 2024-09-16T17:02:38.569 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56280.log.gz 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66278.log 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28983.log.gz 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64100.log 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65984.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65984.log.gz 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30699.log 49.6% 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66278.log.gz 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62903.log 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64100.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64100.log.gz 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61847.log 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30699.log.gz 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37855.log 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62903.log.gz 2024-09-16T17:02:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55063.log 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61847.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61847.log.gz 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36542.log 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37855.log.gz 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44763.log 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55063.log.gz 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28985.log 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36542.log.gz 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44763.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27511.log 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44763.log.gz 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30861.log 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28985.log.gz 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.27511.log: gzip -5 --verbose 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27511.log.gz 2024-09-16T17:02:38.571 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.45559.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30861.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.30861.log.gz --verbose 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.50473.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57314.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45559.log.gz 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63078.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50473.log.gz 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59684.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57314.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.57314.log.gz 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59635.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63078.log.gz 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43404.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59684.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59684.log.gz 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37039.log 2024-09-16T17:02:38.572 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59635.log.gz 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39990.log 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43404.log.gz 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46894.log 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37039.log.gz 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66320.log 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39990.log.gz 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44416.log 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46894.log.gz 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38969.log 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66320.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66320.log.gz 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28561.log 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.44416.log.gz 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.38969.log: --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2024-09-16T17:02:38.573 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38969.log.gz 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28561.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28561.log.gz 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63835.log 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52145.log 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53839.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65186.log 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63835.log.gz 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57782.log 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52145.log.gz 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.65186.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65416.log 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65186.log.gz 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35172.log 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57782.log.gz 2024-09-16T17:02:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46561.log 2024-09-16T17:02:38.575 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65416.log.gz 2024-09-16T17:02:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66110.log 2024-09-16T17:02:38.575 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35172.log.gz 2024-09-16T17:02:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37486.log 2024-09-16T17:02:38.575 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46561.log.gz 2024-09-16T17:02:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36382.log 2024-09-16T17:02:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66110.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66110.log.gz 2024-09-16T17:02:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37486.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37486.log.gz 2024-09-16T17:02:38.576 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55672.log 2024-09-16T17:02:38.576 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32459.log 2024-09-16T17:02:38.577 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36382.log.gz 2024-09-16T17:02:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55672.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55672.log.gz 2024-09-16T17:02:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38396.log 2024-09-16T17:02:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2024-09-16T17:02:38.577 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32459.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32459.log.gz 2024-09-16T17:02:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64017.log 2024-09-16T17:02:38.578 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38396.log.gz 2024-09-16T17:02:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59901.log 2024-09-16T17:02:38.578 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2024-09-16T17:02:38.578 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47870.log 2024-09-16T17:02:38.578 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64017.log.gz 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59901.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59901.log.gz 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36949.log 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44505.log 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47870.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47870.log.gz 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36949.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36949.log.gz 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33046.log 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39672.log 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44505.log: 49.6%/var/log/ceph/ceph-client.admin.33046.log: -- replaced with /var/log/ceph/ceph-client.admin.44505.log.gz 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31445.log 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33046.log.gz 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64632.log 2024-09-16T17:02:38.579 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39672.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39672.log.gz 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52411.log 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31445.log.gz 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47436.log 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64632.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64632.log.gz 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52411.log.gz 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45439.log 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47436.log.gz 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56420.log 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47035.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64443.log 2024-09-16T17:02:38.580 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45439.log.gz 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47212.log 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56420.log.gz 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58995.log 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64443.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64443.log.gz 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47212.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47212.log.gz 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29673.log 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39011.log 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58995.log.gz 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34241.log 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29673.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29673.log.gz 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39011.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39011.log.gz 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62105.log 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29154.log 2024-09-16T17:02:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34241.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34241.log.gz 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56329.log 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62105.log.gz 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31048.log 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29154.log.gz 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46829.log 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56329.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56329.log.gz 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31048.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31048.log.gz 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52727.log 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61031.log 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46829.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46829.log.gz 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52727.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52727.log.gz 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53888.log 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32361.log 2024-09-16T17:02:38.582 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61031.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61031.log.gz 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53888.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53888.log.gz 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37526.log 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51439.log 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32361.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32361.log.gz 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37526.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37526.log.gz 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45301.log 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51439.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51439.log.gz 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45301.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45301.log.gz 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65942.log 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2024-09-16T17:02:38.583 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44289.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31355.log 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65942.log.gz 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56147.log 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31355.log.gz 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33186.log 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55623.log 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56147.log.gz 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32012.log 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.33186.log.gz 2024-09-16T17:02:38.584 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55623.log.gz 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.32012.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38828.log 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32012.log.gz 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29304.log 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37976.log 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38828.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38828.log.gz 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48715.log 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29304.log.gz 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.37976.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37976.log.gz 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.48715.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54307.log 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48715.log.gz 2024-09-16T17:02:38.585 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49204.log 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56796.log 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54307.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54307.log.gz 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53619.log 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49204.log.gz 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52951.log 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.56796.log.gz 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34416.log 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53619.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53619.log.gz 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52951.log.gz 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30180.log 2024-09-16T17:02:38.586 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34416.log.gz 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36502.log 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48924.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32061.log 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30180.log.gz 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42121.log 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36502.log.gz 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49511.log 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32061.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32061.log.gz 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33452.log 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42121.log.gz 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47731.log 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49511.log.gz 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34190.log 2024-09-16T17:02:38.587 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33452.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33452.log.gz/var/log/ceph/ceph-client.admin.47731.log: 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47731.log.gz 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36284.log 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38920.log 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34190.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34190.log.gz 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48357.log 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36284.log.gz 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34021.log 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38920.log.gz 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.48357.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43284.log 2024-09-16T17:02:38.588 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48357.log.gz 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34021.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34021.log.gz 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50783.log 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43284.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43284.log.gz 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34562.log 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50783.log.gz 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39621.log 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65102.log 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gz 2024-09-16T17:02:38.589 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39621.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39621.log.gz 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35081.log 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62145.log 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65102.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65102.log.gz 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33319.log 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35081.log.gz 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61758.log 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62145.log.gz 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33794.log 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33319.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33319.log.gz 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42557.log 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61758.log.gz 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39581.log 2024-09-16T17:02:38.590 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gz 2024-09-16T17:02:38.591 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55294.log 2024-09-16T17:02:38.591 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42557.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42557.log.gz 2024-09-16T17:02:38.591 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66488.log 2024-09-16T17:02:38.591 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39581.log.gz 2024-09-16T17:02:38.591 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36193.log 2024-09-16T17:02:38.591 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55294.log.gz 2024-09-16T17:02:38.591 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.66488.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36909.log 2024-09-16T17:02:38.592 INFO:teuthology.orchestra.run.smithi110.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66488.log.gz 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36193.log: gzip -5 50.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.36193.log.gz /var/log/ceph/ceph-client.admin.35392.log 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57960.log 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36909.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36909.log.gz 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34113.log 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35392.log.gz 2024-09-16T17:02:38.689 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57880.log 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57960.log.gz 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.0.34113.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57880.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57880.log.gz 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40549.log 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31712.log 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.40549.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55392.log 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40549.log.gz 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41843.log 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31712.log.gz 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61967.log 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55392.log.gz 2024-09-16T17:02:38.690 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41843.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41843.log.gz 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57613.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54707.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61967.log.gz 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45915.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57613.log.gz 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44594.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54707.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54707.log.gz 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40509.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45915.log.gz 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65604.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44594.log.gz 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47366.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40509.log.gz 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43026.log 2024-09-16T17:02:38.691 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65604.log.gz 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47366.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47366.log.gz 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.60543.log 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43026.log: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.43026.log.gz 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36780.log 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55014.log 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60543.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60543.log.gz 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36780.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.48090.log 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36780.log.gz 2024-09-16T17:02:38.692 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55014.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55014.log.gz 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59215.log 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48090.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50961.log 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.59215.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48130.log 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59215.log.gz 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50961.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50961.log.gz 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.63925.log 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48130.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48130.log.gz 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35123.log 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63925.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63925.log.gz 2024-09-16T17:02:38.693 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.63400.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35123.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35123.log.gz 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33277.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63400.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63400.log.gz 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42081.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33277.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33277.log.gz 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.31578.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42081.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42081.log.gz 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30131.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31578.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31578.log.gz 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56378.log 2024-09-16T17:02:38.694 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30131.log.gz 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30779.log 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34948.log: gzip 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56378.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45350.log 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56378.log.gz 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30779.log: gzip 49.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.30779.log.gz -- 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.65752.log 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52811.log 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45350.log.gz 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.65752.log: -- /var/log/ceph/ceph-client.admin.43106.log 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65752.log.gz 2024-09-16T17:02:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66654.log 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52811.log.gz 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.43106.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30369.log 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43106.log.gz 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66654.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66654.log.gz 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35704.log 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29771.log 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30369.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30369.log.gz 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35704.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35704.log.gz 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.56558.log 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29771.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29771.log.gz 2024-09-16T17:02:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50255.log 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56558.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56558.log.gz 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52363.log 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50255.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50255.log.gz 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.58138.log 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52363.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52363.log.gz 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58628.log 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58138.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58138.log.gz 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.47961.log 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58628.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58628.log.gz 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60364.log 2024-09-16T17:02:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54974.log 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47961.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47961.log.gz 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60364.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.57635.log 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60364.log.gz 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54974.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54974.log.gz 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32103.log 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57635.log.gz 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32103.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32103.log.gz 2024-09-16T17:02:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63646.log 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44109.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58866.log 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63646.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63646.log.gz 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.44634.log 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58866.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58866.log.gz 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37228.log 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42836.log 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44634.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44634.log.gz 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37228.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37228.log.gz 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.44332.log 2024-09-16T17:02:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42836.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42836.log.gz 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35480.log 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44332.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35935.log 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35480.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35480.log.gz 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.60450.log 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35935.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35935.log.gz 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63162.log 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60450.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60450.log.gz 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.65286.log 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63162.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63162.log.gz 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2024-09-16T17:02:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65286.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65286.log.gz 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.30089.log 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44998.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62945.log 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58089.log 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30089.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30089.log.gz 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29675.log 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62945.log.gz 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58089.log: /var/log/ceph/ceph-client.admin.29675.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.58089.log.gz 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59404.log 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29675.log.gz 2024-09-16T17:02:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46342.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48317.log 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49609.log 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59404.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59404.log.gz 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57531.log 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48317.log.gz 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61927.log 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.49609.log.gz 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.57531.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59493.log 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57531.log.gz 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62985.log 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61927.log.gz 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46689.log 2024-09-16T17:02:38.702 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59493.log.gz 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.62985.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55532.log 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62985.log.gz 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46689.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46689.log.gz 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66530.log 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53490.log 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55532.log.gz 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49769.log 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66530.log.gz 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56905.log 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53490.log.gz 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33137.log 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49769.log.gz 2024-09-16T17:02:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41256.log 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56905.log.gz 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56105.log 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33137.log.gz 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40411.log 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41256.log.gz 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30460.log 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56105.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56105.log.gz 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28707.log 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40411.log.gz 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61887.log 2024-09-16T17:02:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30460.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30460.log.gz 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60174.log 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.28707.log.gz 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58468.log 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61887.log.gz 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55714.log 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60174.log.gz 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60951.log 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58468.log.gz 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51757.log 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55714.log.gz 2024-09-16T17:02:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60951.log.gz 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58948.log 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51757.log.gz 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49302.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.57083.log 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58948.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58948.log.gz 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33226.log 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57083.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29813.log 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57083.log.gz 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46649.log 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33226.log.gz 2024-09-16T17:02:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60315.log 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29813.log.gz 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57831.log 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46649.log.gz 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58548.log 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60315.log.gz 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40589.log 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57831.log.gz 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.58548.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64059.log 49.6% 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58548.log.gz 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40589.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40589.log.gz 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62225.log 2024-09-16T17:02:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43682.log 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64059.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64059.log.gz 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62225.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62225.log.gz 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.28682.log 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43682.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33088.log 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43682.log.gz 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32739.log 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28682.log.gz 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47106.log 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33088.log.gz 2024-09-16T17:02:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29472.log 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32739.log.gz 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.47106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38563.log 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29472.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29472.log.gz 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38563.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38305.log 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33705.log 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.38305.log: --verbose -- /var/log/ceph/ceph-client.0.42331.log 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6%/var/log/ceph/ceph-client.admin.33705.log: -- replaced with /var/log/ceph/ceph-client.admin.38305.log.gz 2024-09-16T17:02:38.709 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41941.log 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33705.log.gz 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29152.log 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.42331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54934.log 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41941.log: /var/log/ceph/ceph-client.admin.29152.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41941.log.gz 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29152.log.gz 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31814.log 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29388.log 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54934.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54934.log.gz 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31814.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31814.log.gz 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31495.log 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53532.log 2024-09-16T17:02:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31495.log: /var/log/ceph/ceph-client.admin.29388.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29388.log.gz 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31495.log.gz 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56985.log 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53532.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53532.log.gz 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56985.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56985.log.gz 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65603.log 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28758.log 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65603.log: /var/log/ceph/ceph-client.admin.43811.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65603.log.gz 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42927.log 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65287.log 2024-09-16T17:02:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28758.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28758.log.gz 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42927.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42927.log.gz 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45041.log 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45782.log 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45041.log: /var/log/ceph/ceph-client.admin.65287.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65287.log.gz 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45041.log.gz 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52684.log 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37348.log 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45782.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45782.log.gz 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52684.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52684.log.gz 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28622.log 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61709.log 2024-09-16T17:02:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37348.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37348.log.gz 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28622.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57125.log 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28622.log.gz 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39200.log 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61709.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61709.log.gz 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29430.log 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57125.log.gz 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50513.log 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39200.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39200.log.gz 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29430.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62065.log 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29430.log.gz 2024-09-16T17:02:38.713 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65060.log 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50513.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50513.log.gz 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49162.log 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62065.log.gz 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31146.log 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49162.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65060.log.gz 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49162.log.gz 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65285.log 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30320.log 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31146.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31146.log.gz 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65285.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65285.log.gz 2024-09-16T17:02:38.714 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60771.log 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51001.log 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60771.log: /var/log/ceph/ceph-client.admin.30320.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30320.log.gz 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60771.log.gz 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40200.log 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35886.log 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51001.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51001.log.gz 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40200.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40200.log.gz 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63884.log 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35886.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35886.log.gz 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44674.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2024-09-16T17:02:38.715 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66194.log 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46738.log: /var/log/ceph/ceph-client.admin.63884.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63884.log.gz 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56598.log 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66068.log 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66194.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66194.log.gz 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56598.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56598.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34283.log 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30601.log 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34283.log: /var/log/ceph/ceph-client.admin.66068.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66068.log.gz 2024-09-16T17:02:38.716 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34283.log.gz 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40070.log 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43542.log 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30601.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30601.log.gz 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40070.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40070.log.gz 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46945.log 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37895.log 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43542.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43542.log.gz 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58886.log 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46945.log.gz 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33976.log 2024-09-16T17:02:38.717 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58886.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37895.log.gz 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58886.log.gz 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56727.log 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33976.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33976.log.gz 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56727.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56727.log.gz 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41036.log 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41036.log: /var/log/ceph/ceph-client.admin.37717.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41036.log.gz 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41803.log 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55797.log 2024-09-16T17:02:38.718 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47163.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41803.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41803.log.gz 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32828.log 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55797.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55797.log.gz 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32828.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32828.log.gz 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49463.log 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36144.log 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49463.log: /var/log/ceph/ceph-client.admin.36422.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49463.log.gz 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33745.log 2024-09-16T17:02:38.719 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39861.log 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36144.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.36144.log.gz 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33745.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33745.log.gz 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30559.log 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37179.log: /var/log/ceph/ceph-client.admin.39861.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39861.log.gz 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64192.log 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57223.log 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30559.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30559.log.gz 2024-09-16T17:02:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64192.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64192.log.gz 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39109.log 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57223.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57223.log.gz 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39109.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39109.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52909.log 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59453.log 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47821.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52909.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50384.log 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52909.log.gz 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45399.log 2024-09-16T17:02:38.721 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59453.log.gz 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50384.log.gz 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45399.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45399.log.gz 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43851.log: /var/log/ceph/ceph-client.admin.48755.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48477.log 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36660.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gzgzip 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36989.log 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64583.log 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48477.log: /var/log/ceph/ceph-client.admin.36989.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48477.log.gz 2024-09-16T17:02:38.722 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36989.log.gz 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30229.log 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39910.log 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64583.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64583.log.gz 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30229.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30229.log.gz 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28532.log 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53937.log 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28532.log: /var/log/ceph/ceph-client.admin.39910.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39910.log.gz 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28532.log.gz 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62323.log 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42787.log 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53937.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53937.log.gz 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62323.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53092.log 2024-09-16T17:02:38.723 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62323.log.gz 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66152.log 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42787.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42787.log.gz 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53252.log 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53092.log.gz 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29514.log 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66152.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66152.log.gz 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53252.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30510.log 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53252.log.gz 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51579.log 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29514.log: /var/log/ceph/ceph-client.admin.30510.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29514.log.gz 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30510.log.gz 2024-09-16T17:02:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58229.log 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42300.log 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51579.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51579.log.gz 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58229.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58229.log.gz 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54168.log 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31186.log 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54168.log: /var/log/ceph/ceph-client.admin.42300.log: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42300.log.gz 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54168.log.gz 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50335.log 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51139.log 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31186.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31186.log.gz 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50335.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50335.log.gz 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31963.log 2024-09-16T17:02:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51139.log: /var/log/ceph/ceph-client.admin.31963.log: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51139.log.gz 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31963.log.gz 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64808.log 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45081.log 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44456.log: /var/log/ceph/ceph-client.admin.64808.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64808.log.gz 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39812.log 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29843.log 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45081.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45081.log.gz 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39812.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39812.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62672.log 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51299.log 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.29843.log: /var/log/ceph/ceph-client.admin.62672.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62672.log.gz 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51299.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51299.log.gz 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28800.log 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45657.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28800.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28800.log.gz 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51090.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37815.log 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37626.log 2024-09-16T17:02:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37815.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37815.log.gz 2024-09-16T17:02:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42517.log 2024-09-16T17:02:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37626.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37626.log.gz 2024-09-16T17:02:38.730 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54028.log 2024-09-16T17:02:38.730 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46044.log 2024-09-16T17:02:38.730 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54028.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42517.log.gz 2024-09-16T17:02:38.730 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54028.log.gz 2024-09-16T17:02:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62532.log 2024-09-16T17:02:38.731 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46044.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46044.log.gz 2024-09-16T17:02:38.733 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55203.log 2024-09-16T17:02:38.746 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62532.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62532.log.gz 2024-09-16T17:02:38.748 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2024-09-16T17:02:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55203.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55203.log.gz 2024-09-16T17:02:38.757 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44029.log 2024-09-16T17:02:38.766 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61429.log 2024-09-16T17:02:38.770 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44029.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2024-09-16T17:02:38.778 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44029.log.gz 2024-09-16T17:02:38.782 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61618.log 2024-09-16T17:02:38.782 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61429.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61429.log.gz 2024-09-16T17:02:38.791 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2024-09-16T17:02:38.791 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61618.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.61618.log.gz 2024-09-16T17:02:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58278.log 2024-09-16T17:02:38.800 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49113.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2024-09-16T17:02:38.809 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53797.log 2024-09-16T17:02:38.822 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58278.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58278.log.gz 2024-09-16T17:02:38.828 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61300.log 2024-09-16T17:02:38.828 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53797.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53797.log.gz 2024-09-16T17:02:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2024-09-16T17:02:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61300.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61300.log.gz 2024-09-16T17:02:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48010.log 2024-09-16T17:02:38.858 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40320.log 2024-09-16T17:02:38.858 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48010.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48010.log.gz 2024-09-16T17:02:38.862 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2024-09-16T17:02:38.867 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62185.log 2024-09-16T17:02:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51877.log 2024-09-16T17:02:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62185.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62185.log.gz 2024-09-16T17:02:38.880 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40320.log.gz 2024-09-16T17:02:38.886 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.56026.log.gz 2024-09-16T17:02:38.887 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48219.log 2024-09-16T17:02:38.887 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51877.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51877.log.gz 2024-09-16T17:02:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64394.log 2024-09-16T17:02:38.890 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48219.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.48219.log.gz 2024-09-16T17:02:38.890 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30251.log 2024-09-16T17:02:38.890 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64394.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64394.log.gz 2024-09-16T17:02:38.892 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31626.log 2024-09-16T17:02:38.892 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30251.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30251.log.gz 2024-09-16T17:02:38.892 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60501.log 2024-09-16T17:02:38.892 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31626.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31626.log.gz 2024-09-16T17:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30040.log 2024-09-16T17:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60501.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60501.log.gz 2024-09-16T17:02:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65415.log 2024-09-16T17:02:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30040.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30040.log.gz 2024-09-16T17:02:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2024-09-16T17:02:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65415.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65415.log.gz 2024-09-16T17:02:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54077.log 2024-09-16T17:02:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41763.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2024-09-16T17:02:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39249.log 2024-09-16T17:02:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54077.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54077.log.gz 2024-09-16T17:02:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58040.log 2024-09-16T17:02:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39249.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39249.log.gz 2024-09-16T17:02:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59726.log 2024-09-16T17:02:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58040.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58040.log.gz 2024-09-16T17:02:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48882.log 2024-09-16T17:02:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59726.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59726.log.gz 2024-09-16T17:02:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62630.log 2024-09-16T17:02:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48882.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48882.log.gz 2024-09-16T17:02:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54387.log 2024-09-16T17:02:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62630.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62630.log.gz 2024-09-16T17:02:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49382.log 2024-09-16T17:02:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54387.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54387.log.gz 2024-09-16T17:02:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40807.log 2024-09-16T17:02:38.909 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49382.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49382.log.gz 2024-09-16T17:02:38.909 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42737.log 2024-09-16T17:02:38.910 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40807.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40807.log.gz 2024-09-16T17:02:38.910 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32499.log 2024-09-16T17:02:38.910 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42737.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2024-09-16T17:02:38.910 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63211.log 2024-09-16T17:02:38.910 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32499.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32499.log.gz 2024-09-16T17:02:38.914 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38074.log 2024-09-16T17:02:38.914 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63211.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63211.log.gz 2024-09-16T17:02:38.914 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2024-09-16T17:02:38.914 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38074.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38074.log.gz 2024-09-16T17:02:38.914 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34633.log 2024-09-16T17:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45161.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2024-09-16T17:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35965.log 2024-09-16T17:02:38.915 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34633.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34633.log.gz 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60589.log 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35965.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35965.log.gz 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60589.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60589.log.gz 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41983.log 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44554.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31813.log 2024-09-16T17:02:38.919 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41983.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41983.log.gz 2024-09-16T17:02:38.923 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50433.log 2024-09-16T17:02:38.923 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31813.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31813.log.gz 2024-09-16T17:02:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43493.log 2024-09-16T17:02:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50433.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50433.log.gz 2024-09-16T17:02:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50077.log 2024-09-16T17:02:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43493.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43493.log.gz 2024-09-16T17:02:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55574.log 2024-09-16T17:02:38.924 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50077.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50077.log.gz 2024-09-16T17:02:38.928 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40119.log 2024-09-16T17:02:38.928 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55574.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55574.log.gz 2024-09-16T17:02:38.928 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63744.log 2024-09-16T17:02:38.928 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40119.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40119.log.gz 2024-09-16T17:02:38.928 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54427.log 2024-09-16T17:02:38.929 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63744.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63744.log.gz 2024-09-16T17:02:38.929 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41585.log 2024-09-16T17:02:38.929 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54427.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54427.log.gz 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62721.log 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41585.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41585.log.gz 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51259.log 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62721.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62721.log.gz 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45121.log 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51259.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51259.log.gz 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33617.log 2024-09-16T17:02:38.933 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45121.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45121.log.gz 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46124.log 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33617.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33617.log.gz 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62770.log 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46124.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46124.log.gz 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53390.log 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62770.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62770.log.gz 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63786.log 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53390.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53390.log.gz 2024-09-16T17:02:38.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30650.log 2024-09-16T17:02:38.940 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63786.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63786.log.gz 2024-09-16T17:02:38.944 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64492.log 2024-09-16T17:02:38.944 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30650.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30650.log.gz 2024-09-16T17:02:38.944 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66236.log 2024-09-16T17:02:38.944 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64492.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64492.log.gz 2024-09-16T17:02:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64765.log 2024-09-16T17:02:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66236.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66236.log.gz 2024-09-16T17:02:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43146.log 2024-09-16T17:02:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64765.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64765.log.gz 2024-09-16T17:02:38.945 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34061.log 2024-09-16T17:02:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43146.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43146.log.gz 2024-09-16T17:02:38.949 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2024-09-16T17:02:38.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34061.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34061.log.gz 2024-09-16T17:02:38.950 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43324.log 2024-09-16T17:02:38.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44714.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2024-09-16T17:02:38.950 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35305.log 2024-09-16T17:02:38.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43324.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43324.log.gz 2024-09-16T17:02:38.950 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49342.log 2024-09-16T17:02:38.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35305.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35305.log.gz 2024-09-16T17:02:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55112.log 2024-09-16T17:02:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49342.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49342.log.gz 2024-09-16T17:02:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52012.log 2024-09-16T17:02:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55112.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55112.log.gz 2024-09-16T17:02:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52635.log 2024-09-16T17:02:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52012.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52012.log.gz 2024-09-16T17:02:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30908.log 2024-09-16T17:02:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52635.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52635.log.gz 2024-09-16T17:02:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29153.log 2024-09-16T17:02:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30908.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30908.log.gz 2024-09-16T17:02:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53659.log 2024-09-16T17:02:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29153.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29153.log.gz 2024-09-16T17:02:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38461.log 2024-09-16T17:02:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53659.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53659.log.gz 2024-09-16T17:02:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56025.log 2024-09-16T17:02:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38461.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38461.log.gz 2024-09-16T17:02:38.967 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30418.log 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56025.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56025.log.gz 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30739.log 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30418.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30418.log.gz 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41305.log 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30739.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30739.log.gz 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63506.log 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41305.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41305.log.gz 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52318.log 2024-09-16T17:02:38.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63506.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63506.log.gz 2024-09-16T17:02:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38441.log 2024-09-16T17:02:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52318.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52318.log.gz 2024-09-16T17:02:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30801.log 2024-09-16T17:02:38.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38441.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38441.log.gz 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64234.log 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30801.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30801.log.gz 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54756.log 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64234.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64234.log.gz 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65564.log 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54756.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54756.log.gz 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65018.log 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65564.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65564.log.gz 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40907.log 2024-09-16T17:02:39.031 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.34113.log.gz 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65018.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43633.log 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65018.log.gz 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57573.log 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40907.log: /var/log/ceph/ceph-client.admin.43633.log: 49.6% 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40907.log.gz 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43633.log.gz 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39721.log 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57573.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32868.log 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57573.log.gz 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48795.log 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32868.log: /var/log/ceph/ceph-client.admin.39721.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2024-09-16T17:02:39.032 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32868.log.gz 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53172.log 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48795.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52544.log 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48795.log.gz 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64892.log 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53172.log: /var/log/ceph/ceph-client.admin.52544.log: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53172.log.gz 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52544.log.gz 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34500.log 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48526.log 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64892.log.gz 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60132.log 2024-09-16T17:02:39.033 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34500.log.gz 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55252.log 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60132.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48526.log.gz 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60132.log.gz 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31404.log 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.55252.log: -- /var/log/ceph/ceph-client.admin.42032.log 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.55252.log.gz 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42259.log 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42032.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31404.log.gz 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42032.log.gz 2024-09-16T17:02:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66362.log 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61051.log 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42259.log.gz 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48150.log 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61051.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66362.log.gz 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.61051.log.gz 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40030.log 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48150.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31226.log 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48150.log.gz 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40030.log.gz 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2024-09-16T17:02:39.035 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31226.log.gz 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41723.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50146.log 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49022.log: -- /var/log/ceph/ceph-client.admin.34766.log 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55343.log 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34766.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50146.log.gz 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34766.log.gz 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55934.log 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55343.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55483.log 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55343.log.gz 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54616.log 2024-09-16T17:02:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55934.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55934.log.gz 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29262.log 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55483.log.gz 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54616.log: /var/log/ceph/ceph-client.admin.29262.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54616.log.gz 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29262.log.gz 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60911.log 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64532.log 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60911.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60911.log.gz 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31537.log 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64532.log: 88.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T17:02:39.037 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64532.log.gz 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63957.log 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35662.log 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31537.log.gz 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39389.log 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35662.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63957.log.gz 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35662.log.gz 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57034.log 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37667.log 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39389.log.gz 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2024-09-16T17:02:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37667.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57034.log.gz 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37667.log.gz 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51624.log 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42214.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.55754.log 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39060.log 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51624.log: /var/log/ceph/ceph-client.admin.55754.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51624.log.gz 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55754.log.gz 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40629.log 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39060.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59593.log 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39060.log.gz 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34112.log 2024-09-16T17:02:39.039 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40629.log.gz 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62581.log 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59593.log.gz/var/log/ceph/ceph-client.admin.34112.log: 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34112.log.gz 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66572.log 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62581.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54825.log 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62581.log.gz 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47075.log 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66572.log: /var/log/ceph/ceph-client.admin.54825.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66572.log.gz 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54825.log.gz 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53212.log 2024-09-16T17:02:39.040 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47075.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47075.log.gz 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59124.log 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53212.log: /var/log/ceph/ceph-client.admin.38730.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53212.log.gz 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58508.log 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65455.log 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59124.log.gz 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34857.log 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65455.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58508.log.gz 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65455.log.gz 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45866.log 2024-09-16T17:02:39.041 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34857.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34857.log.gz 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51928.log 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45866.log.gz 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60615.log 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6%/var/log/ceph/ceph-client.admin.51928.log: -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51928.log.gz 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.60615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41165.log 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43364.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45738.log 2024-09-16T17:02:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41165.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41165.log.gz 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43066.log 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45738.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45738.log.gz 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35438.log 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.47106.log.gz 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43066.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43066.log.gz 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59313.log 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58677.log 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35438.log.gz 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42695.log 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59313.log.gz 2024-09-16T17:02:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58677.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58677.log.gz 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36865.log 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41354.log 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42695.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42695.log.gz 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36865.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42856.log 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36865.log.gz 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41354.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41354.log.gz 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31877.log 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52460.log 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42856.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42856.log.gz 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31877.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.51780.log 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52460.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52460.log.gz 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63280.log 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58419.log 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.51780.log: /var/log/ceph/ceph-client.admin.63280.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63280.log.gz 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.42331.log.gz 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54567.log 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58419.log.gz 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53350.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32550.log 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59817.log 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54567.log.gz 2024-09-16T17:02:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32550.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32550.log.gz 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35591.log 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59817.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59817.log.gz 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33663.log 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52769.log 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35591.log.gz 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33663.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33663.log.gz 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57742.log 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52769.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52769.log.gz 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49818.log 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49907.log 2024-09-16T17:02:39.046 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57742.log.gz 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49818.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49818.log.gz 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38496.log 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49907.log.gz 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38496.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38496.log.gz 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62411.log 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37088.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-09-16T17:02:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60224.log 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60813.log 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62411.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62411.log.gz 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60224.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60224.log.gz 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56776.log 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39438.log 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56776.log: /var/log/ceph/ceph-client.admin.60813.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60813.log.gz 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56776.log.gz 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43591.log 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44952.log 2024-09-16T17:02:39.153 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39438.log.gz 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43591.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43591.log.gz 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56678.log 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63555.log 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44952.log: /var/log/ceph/ceph-client.admin.56678.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56678.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44952.log.gz 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62016.log 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.63555.log: /var/log/ceph/ceph-client.admin.54805.log 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63555.log.gz 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40669.log 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54805.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62016.log.gz 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54805.log.gz 2024-09-16T17:02:39.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59990.log 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40669.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63036.log 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40669.log.gz 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59264.log 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59990.log: /var/log/ceph/ceph-client.admin.63036.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59990.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63036.log.gz 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51706.log 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40180.log 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.59264.log.gz 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39480.log 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40180.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51706.log.gz 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40180.log.gz 2024-09-16T17:02:39.155 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55849.log 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39480.log.gz 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55154.log 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47345.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55849.log.gz 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55154.log.gz 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36640.log 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57700.log 2024-09-16T17:02:39.156 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0%/var/log/ceph/ceph-client.admin.36640.log: -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36640.log.gz 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46262.log 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48050.log 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57700.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57700.log.gz 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46262.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.46262.log.gz 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56220.log 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41445.log 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56220.log: /var/log/ceph/ceph-client.admin.48050.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48050.log.gz 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56220.log.gz 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49649.log 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33843.log 2024-09-16T17:02:39.157 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41445.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41445.log.gz 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49649.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49649.log.gz 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33843.log: /var/log/ceph/ceph-client.admin.46222.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33843.log.gz 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32410.log 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50643.log 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47560.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32410.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32410.log.gz 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37577.log 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52187.log 2024-09-16T17:02:39.158 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50643.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50643.log.gz 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37577.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37577.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57397.log 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42477.log 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52187.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52187.log.gz 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57397.log.gz 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28984.log 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42477.log: /var/log/ceph/ceph-client.admin.33905.log: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42477.log.gz 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-09-16T17:02:39.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38779.log 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42977.log 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28984.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28984.log.gz 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38779.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38779.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47520.log 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40956.log 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47520.log: /var/log/ceph/ceph-client.admin.42977.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42977.log.gz 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47520.log.gz 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38025.log 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49560.log 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40956.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40956.log.gz 2024-09-16T17:02:39.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38025.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38025.log.gz 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41634.log 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45826.log 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41634.log: /var/log/ceph/ceph-client.admin.49560.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41634.log.gz 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65809.log 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45826.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45826.log.gz 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65809.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65809.log.gz 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56469.log 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59173.log 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56469.log: /var/log/ceph/ceph-client.admin.44129.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-09-16T17:02:39.161 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56469.log.gz 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49988.log 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59173.log: -- /var/log/ceph/ceph-client.admin.46382.log 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59173.log.gz 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64673.log 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6%/var/log/ceph/ceph-client.admin.46382.log: -- replaced with /var/log/ceph/ceph-client.admin.49988.log.gz 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51664.log 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29094.log 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64673.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64673.log.gz 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51664.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51664.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48973.log 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53979.log 2024-09-16T17:02:39.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29094.log: /var/log/ceph/ceph-client.admin.48973.log: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29094.log.gz 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48973.log.gz 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53979.log: 50.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32321.log 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53979.log.gz 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39340.log 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46004.log: /var/log/ceph/ceph-client.admin.32321.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32321.log.gz 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32241.log 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39340.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39340.log.gz 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46873.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gzgzip 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log 2024-09-16T17:02:39.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37437.log: /var/log/ceph/ceph-client.admin.32241.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32241.log.gz 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64722.log 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64314.log 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54888.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64722.log.gz 49.6% 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63260.log 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35214.log 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64314.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64314.log.gz 2024-09-16T17:02:39.164 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63260.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63260.log.gz 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34540.log 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57489.log 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34540.log: /var/log/ceph/ceph-client.admin.35214.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34540.log.gz 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35214.log.gz 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37268.log 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50126.log 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57489.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57489.log.gz 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37268.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33536.log 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37268.log.gz 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62452.log 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50126.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50126.log.gz 2024-09-16T17:02:39.165 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33536.log: 47.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54117.log 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33536.log.gz 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66404.log 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62452.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62452.log.gz 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54117.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.54117.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60673.log 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66404.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66404.log.gz 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48666.log: gzip 50.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56518.log 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60673.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60673.log.gz 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61121.log 2024-09-16T17:02:39.166 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61121.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56518.log.gz 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61121.log.gz 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51219.log 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33885.log: -- /var/log/ceph/ceph-client.admin.52236.log 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34990.log 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51219.log.gz/var/log/ceph/ceph-client.admin.52236.log: 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52236.log.gz 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42388.log 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60862.log 2024-09-16T17:02:39.167 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34990.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34990.log.gz 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42388.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42388.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29576.log 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29576.log: /var/log/ceph/ceph-client.admin.60862.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60862.log.gz 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29576.log.gz 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38611.log 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32201.log 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47771.log: /var/log/ceph/ceph-client.admin.38611.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38611.log.gz 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31006.log 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29346.log 2024-09-16T17:02:39.168 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32201.log.gz 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38116.log 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29346.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31006.log.gz 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29346.log.gz 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30957.log 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38354.log 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38116.log.gz 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.30957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30957.log.gz 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36462.log 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48397.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38354.log.gz 2024-09-16T17:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61520.log 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61171.log 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36462.log: /var/log/ceph/ceph-client.admin.61520.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36462.log.gz 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61520.log.gz 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53748.log 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63447.log 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61171.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61171.log.gz 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53748.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53748.log.gz 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51488.log 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52091.log 2024-09-16T17:02:39.170 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51488.log: /var/log/ceph/ceph-client.admin.63447.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63447.log.gz 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51488.log.gz 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32645.log 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52091.log: /var/log/ceph/ceph-client.admin.32645.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52091.log.gz 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% 93.9% -- replaced with /var/log/ceph/ceph-client.0.29843.log.gz 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32645.log.gz 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44247.log 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57174.log 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44247.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gz 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32690.log 2024-09-16T17:02:39.171 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57174.log.gz 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.32690.log: --verbose -- /var/log/ceph/ceph-client.admin.63695.log 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32690.log.gz 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37130.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32788.log 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63695.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63695.log.gz 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50295.log 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32788.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61260.log 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32788.log.gz 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50295.log.gz 2024-09-16T17:02:39.172 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34906.log 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61260.log.gz 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50553.log 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49064.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34906.log: /var/log/ceph/ceph-client.admin.50553.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34906.log.gz 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65288.log 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50553.log.gz 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46173.log 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51826.log 2024-09-16T17:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65288.log: /var/log/ceph/ceph-client.admin.46173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58768.log 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65288.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46173.log.gz 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51826.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51826.log.gz 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53132.log 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58768.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58768.log.gz 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.44852.log 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53132.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53132.log.gz 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44198.log 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44852.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.65144.log 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44852.log.gz 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36731.log 2024-09-16T17:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44198.log.gz 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65144.log: /var/log/ceph/ceph-client.admin.36731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54347.log 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36731.log.gz 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65144.log.gz 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.28986.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33576.log 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58817.log 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54347.log.gz 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66614.log 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33576.log: /var/log/ceph/ceph-client.admin.58817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31097.log 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.33576.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58817.log.gz 2024-09-16T17:02:39.175 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66614.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66614.log.gz 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41892.log 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31097.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31097.log.gz 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53441.log 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41892.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41892.log.gz 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.38651.log 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53441.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53441.log.gz 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62811.log 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38651.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38651.log.gz 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62853.log 2024-09-16T17:02:39.176 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62811.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62811.log.gz 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59746.log 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62853.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62853.log.gz 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42646.log 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59746.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.59746.log.gz 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52278.log 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42646.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42646.log.gz 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.59921.log 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52278.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52278.log.gz 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55870.log 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59921.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59921.log.gz 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41494.log 2024-09-16T17:02:39.177 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55870.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55870.log.gz 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.47912.log 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41494.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60722.log 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47912.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47912.log.gz 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51041.log 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60722.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60722.log.gz 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51041.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51041.log.gz 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.63351.log 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46779.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53579.log 2024-09-16T17:02:39.178 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63351.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63351.log.gz 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.52993.log 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53579.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53579.log.gz 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38673.log 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52993.log.gz 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.38673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56187.log 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63604.log 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gz 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66446.log 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56187.log.gz 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43771.log 2024-09-16T17:02:39.179 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6%/var/log/ceph/ceph-client.admin.66446.log: -- replaced with /var/log/ceph/ceph-client.admin.63604.log.gz 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66446.log.gz 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36104.log 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53043.log 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43771.log.gz 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34324.log 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36104.log: /var/log/ceph/ceph-client.admin.53043.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36104.log.gz 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53043.log.gz 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58180.log 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.34324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46302.log 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34324.log.gz 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39950.log 2024-09-16T17:02:39.180 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46302.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58180.log.gz 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46302.log.gz 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45677.log 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39950.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47478.log 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39950.log.gz 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50028.log 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45677.log: /var/log/ceph/ceph-client.admin.47478.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47478.log.gz 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59544.log 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50028.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50832.log 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50028.log.gz 2024-09-16T17:02:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48815.log 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59544.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59544.log.gz 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50832.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50832.log.gz 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31670.log 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48815.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48815.log.gz 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61340.log 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51348.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31670.log.gz 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31306.log 2024-09-16T17:02:39.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61340.log.gz 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.31306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38870.log 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43989.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31306.log.gz 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gz 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44812.log 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29900.log 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38870.log.gz 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62492.log 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.29900.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44812.log.gz 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29900.log.gz 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32599.log 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33402.log 2024-09-16T17:02:39.183 INFO:teuthology.orchestra.run.smithi002.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62492.log.gz 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64934.log 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32599.log.gz/var/log/ceph/ceph-client.admin.33402.log: 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33402.log.gz 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46431.log 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58323.log 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64934.log.gz 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46431.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46431.log.gz 2024-09-16T17:02:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58323.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58323.log.gz 2024-09-16T17:02:39.317 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.60615.log.gz 2024-09-16T17:02:39.326 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.51780.log.gz 2024-09-16T17:02:39.368 INFO:teuthology.orchestra.run.smithi002.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T17:02:39.474 INFO:teuthology.orchestra.run.smithi002.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.38673.log.gz 2024-09-16T17:02:42.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-16T17:02:42.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-16T17:02:44.062 INFO:teuthology.orchestra.run.smithi110.stderr: 95.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T17:02:44.259 INFO:teuthology.orchestra.run.smithi110.stderr: 95.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T17:02:44.261 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-16T17:02:44.261 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m5.805s 2024-09-16T17:02:44.261 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m10.961s 2024-09-16T17:02:44.261 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.494s 2024-09-16T17:02:45.136 INFO:teuthology.orchestra.run.smithi002.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T17:02:45.910 INFO:teuthology.orchestra.run.smithi002.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T17:02:45.912 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-16T17:02:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m7.459s 2024-09-16T17:02:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m17.479s 2024-09-16T17:02:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m1.127s 2024-09-16T17:02:45.913 INFO:tasks.ceph:Archiving logs... 2024-09-16T17:02:45.913 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394/remote/smithi002/log 2024-09-16T17:02:45.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:02:48.412 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394/remote/smithi110/log 2024-09-16T17:02:48.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T17:02:49.904 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T17:02:49.913 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T17:02:49.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:02:49.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T17:02:49.999 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T17:02:50.008 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T17:02:50.008 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:02:50.011 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T17:02:50.025 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:02:50.027 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-16T17:02:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:02:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-16T17:02:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -320us[ -322us] +/- 38ms 2024-09-16T17:02:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -30us[ -32us] +/- 71ms 2024-09-16T17:02:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +523us[ +523us] +/- 60ms 2024-09-16T17:02:50.030 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:02:50.031 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T17:02:50.031 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-16T17:02:50.032 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -315us[ -309us] +/- 38ms 2024-09-16T17:02:50.032 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -19us[ -13us] +/- 71ms 2024-09-16T17:02:50.032 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +534us[ +540us] +/- 60ms 2024-09-16T17:02:50.032 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T17:02:50.033 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T17:02:50.041 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T17:02:50.041 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T17:02:50.091 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:02:50.178 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T17:02:50.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:02:50.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:02:50.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T17:02:50.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:02:50.305 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T17:02:50.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T17:02:50.358 INFO:teuthology.task.internal:Duration was 1573.966420 seconds 2024-09-16T17:02:50.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T17:02:50.409 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T17:02:50.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:02:50.412 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T17:02:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:02:50.451 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T17:02:50.752 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T17:02:50.753 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-16T17:02:50.753 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:02:50.814 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-16T17:02:50.815 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T17:02:50.843 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T17:02:50.843 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:02:50.857 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T17:02:50.911 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T17:02:50.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:02:50.925 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T17:02:51.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T17:02:51.068 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T17:02:51.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:02:51.094 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T17:02:51.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T17:02:51.126 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:02:51.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:02:51.157 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-16T17:02:51.181 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-16T17:02:51.201 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:02:51.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:02:51.236 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T17:02:51.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T17:02:51.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T17:02:51.264 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T17:02:51.265 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394/remote/smithi002 2024-09-16T17:02:51.265 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:02:51.312 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_16:23:48-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7907394/remote/smithi110 2024-09-16T17:02:51.312 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T17:02:51.344 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T17:02:51.344 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:02:51.348 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T17:02:51.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T17:02:51.404 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T17:02:51.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T17:02:51.442 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T17:02:51.442 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:02:51.444 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T17:02:51.457 INFO:teuthology.orchestra.run.smithi002.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:02 /home/ubuntu/cephtest 2024-09-16T17:02:51.459 INFO:teuthology.orchestra.run.smithi110.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 17:02 /home/ubuntu/cephtest 2024-09-16T17:02:51.460 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T17:02:51.491 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T17:02:51.597 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} duration: 1573.966420173645 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T17:02:51.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T17:02:51.677 INFO:teuthology.run:pass